[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:37 dist-test-slave-tm1g krb5kdc[29983](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:37 dist-test-slave-tm1g krb5kdc[29983](info): set up 2 sockets
Aug 06 15:07:37 dist-test-slave-tm1g krb5kdc[29983](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260806 15:07:38.695071 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:38 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:38.831404 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:41351
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:41351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:38.938649 29997 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:38.938846 29997 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:38.938872 29997 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:38.940104 29997 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:38.940145 29997 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:38.940160 29997 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:38.940171 29997 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:38.940225 29997 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:38.941797 29997 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:41351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:41351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29997
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:38.942056 29997 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:38.942373 29997 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:38.949311 30002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:38.949352 29997 server_base.cc:1034] running on GCE node
W20260806 15:07:38.949347 30003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:38.949625 30005 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:38.949898 29997 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:38.950142 29997 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:38.951280 29997 hybrid_clock.cc:648] HybridClock initialized: now 1786028858951269 us; error 28 us; skew 500 ppm
Aug 06 15:07:38 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028858, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:38.953766 29997 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:38.954263 29997 webserver.cc:460] Webserver started at http://127.29.69.190:38621/ using document root <none> and password file <none>
I20260806 15:07:38.954531 29997 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:38.954586 29997 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:38.954675 29997 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:38.955910 29997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "66377df6ee4d44d18dd2f172234e4b2e"
format_stamp: "Formatted at 2026-08-06 15:07:38 on dist-test-slave-tm1g"
server_key: "00df1655f04abe6929869cfb3ccb9e97"
server_key_iv: "e16712a2fb566bf87ab6be605f64b813"
server_key_version: "encryptionkey@0"
I20260806 15:07:38.956519 29997 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "66377df6ee4d44d18dd2f172234e4b2e"
format_stamp: "Formatted at 2026-08-06 15:07:38 on dist-test-slave-tm1g"
server_key: "00df1655f04abe6929869cfb3ccb9e97"
server_key_iv: "e16712a2fb566bf87ab6be605f64b813"
server_key_version: "encryptionkey@0"
I20260806 15:07:38.957932 29997 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:07:38.958945 30013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:38.959245 29997 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:38.959419 29997 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "66377df6ee4d44d18dd2f172234e4b2e"
format_stamp: "Formatted at 2026-08-06 15:07:38 on dist-test-slave-tm1g"
server_key: "00df1655f04abe6929869cfb3ccb9e97"
server_key_iv: "e16712a2fb566bf87ab6be605f64b813"
server_key_version: "encryptionkey@0"
I20260806 15:07:38.959504 29997 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:38.991943 29997 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:38.994275 29997 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:38.994480 29997 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:39.004317 29997 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:41351
I20260806 15:07:39.004370 30067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:41351 every 8 connection(s)
I20260806 15:07:39.004853 29997 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:39.005944 30068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:39.007192 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 29997
I20260806 15:07:39.007349 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:39.008370 29974 external_mini_cluster.cc:1428] Setting key 2af53c7fda60944303acb6d116e1b4bd
I20260806 15:07:39.010032 30068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e: Bootstrap starting.
I20260806 15:07:39.011585 30068 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:39.012614 30068 log.cc:824] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:39.013775 30068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e: No bootstrap required, opened a new log
I20260806 15:07:39.018559 30068 raft_consensus.cc:348] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66377df6ee4d44d18dd2f172234e4b2e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41351 } }
I20260806 15:07:39.018765 30068 raft_consensus.cc:374] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:39.018836 30068 raft_consensus.cc:729] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66377df6ee4d44d18dd2f172234e4b2e, State: Initialized, Role: FOLLOWER
I20260806 15:07:39.018989 30068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66377df6ee4d44d18dd2f172234e4b2e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41351 } }
I20260806 15:07:39.019080 30068 raft_consensus.cc:388] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:39.019125 30068 raft_consensus.cc:482] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:39.019170 30068 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:39.020193 30068 raft_consensus.cc:504] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66377df6ee4d44d18dd2f172234e4b2e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41351 } }
I20260806 15:07:39.020308 30068 leader_election.cc:302] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 66377df6ee4d44d18dd2f172234e4b2e; no voters:
I20260806 15:07:39.020529 30068 leader_election.cc:288] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:39.020648 30074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:39.020816 30068 sys_catalog.cc:564] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:39.020915 30074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [term 1 LEADER]: Becoming Leader. State: Replica: 66377df6ee4d44d18dd2f172234e4b2e, State: Running, Role: LEADER
I20260806 15:07:39.021062 30074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66377df6ee4d44d18dd2f172234e4b2e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41351 } }
I20260806 15:07:39.022096 30076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "66377df6ee4d44d18dd2f172234e4b2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66377df6ee4d44d18dd2f172234e4b2e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41351 } } }
I20260806 15:07:39.022213 30076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:39.022643 30077 sys_catalog.cc:455] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 66377df6ee4d44d18dd2f172234e4b2e. Latest consensus state: current_term: 1 leader_uuid: "66377df6ee4d44d18dd2f172234e4b2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "66377df6ee4d44d18dd2f172234e4b2e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41351 } } }
I20260806 15:07:39.022771 30077 sys_catalog.cc:458] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:39.022987 30084 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:39.023797 30084 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:39.026149 30084 catalog_manager.cc:1347] Generated new cluster ID: 8b02b43d6b4c4d2da1f993eea068ad27
I20260806 15:07:39.026218 30084 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028858, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:39.033236 30072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.009527 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52668 (local address 127.29.69.190:41351)
0806 15:07:39.009862 (+ 335us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:39.009869 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:39.009906 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:07:39.014539 (+ 4633us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:39.014546 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:39.014597 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:39.014711 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:39.017823 (+ 3112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.019518 (+ 1695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.021396 (+ 1878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.022444 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.022607 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.028043 (+ 5436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:39.028047 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:39.028048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:39.028060 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:39.030827 (+ 2767us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.031393 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.031397 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.031398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.031520 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.031810 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.031811 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.031812 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.032214 (+ 402us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:39.032507 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:39.032630 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 15:07:39.032776 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":155,"threads_started":1}
I20260806 15:07:39.045580 30084 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:39.046169 30084 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:39.050839 30084 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 66377df6ee4d44d18dd2f172234e4b2e: Generated new TSK 0
I20260806 15:07:39.051067 30084 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:39.081641 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41351
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:39.190912 30096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:39.191118 30096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:39.191141 30096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:39.192288 30096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:39.192332 30096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:39.192358 30096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:39.193819 30096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41351
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:39.194059 30096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:39.194327 30096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:39.199543 30102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:39.199566 30104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:39.199537 30101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:39.199793 30096 server_base.cc:1034] running on GCE node
I20260806 15:07:39.200049 30096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:39.200289 30096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:39.201470 30096 hybrid_clock.cc:648] HybridClock initialized: now 1786028859201455 us; error 26 us; skew 500 ppm
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:39.204038 30096 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:39.204412 30096 webserver.cc:460] Webserver started at http://127.29.69.129:36597/ using document root <none> and password file <none>
I20260806 15:07:39.204598 30096 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:39.204638 30096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:39.204728 30096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:39.205713 30096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "85a88cce07a84a11bed76360f506802f"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "f1b14ce5f35f73f3602354d6d80d7749"
server_key_iv: "9a08103dfc92f7b6142549d17be59fd0"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.206125 30096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "85a88cce07a84a11bed76360f506802f"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "f1b14ce5f35f73f3602354d6d80d7749"
server_key_iv: "9a08103dfc92f7b6142549d17be59fd0"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.207585 30096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:39.208326 30111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.208531 30096 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:39.208606 30096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "85a88cce07a84a11bed76360f506802f"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "f1b14ce5f35f73f3602354d6d80d7749"
server_key_iv: "9a08103dfc92f7b6142549d17be59fd0"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.208662 30096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:39.218829 30096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:39.221160 30096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:39.221272 30096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:39.221444 30096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:39.221697 30096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:39.221726 30096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.221746 30096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:39.221796 30096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.228170 30096 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:42229
I20260806 15:07:39.228245 30226 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:42229 every 8 connection(s)
I20260806 15:07:39.228570 30096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:39.236856 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30096
I20260806 15:07:39.236960 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:39.237130 29974 external_mini_cluster.cc:1428] Setting key db9b66cfd97559d94a097efcf2275d63
I20260806 15:07:39.237355 30072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.229347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:55471 (local address 127.29.69.190:41351)
0806 15:07:39.229390 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:39.229392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:39.229604 (+ 212us) server_negotiation.cc:407] Connection header received
0806 15:07:39.230055 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:39.230056 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:39.230066 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:39.230119 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:39.231130 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.231647 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.232576 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.232768 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.232816 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.234823 (+ 2007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:39.234824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:39.234825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:39.234831 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:39.235992 (+ 1161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.236342 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.236343 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.236343 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.236397 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.236625 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.236626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.236626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.236779 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:39.236851 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:39.237165 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 15:07:39.237260 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:39.237550 30230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.229324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:41351 (local address 127.29.69.129:55471)
0806 15:07:39.229482 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:39.229516 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:39.229976 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:39.230166 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:39.230169 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:39.230855 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:39.231054 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:39.231059 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.231724 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.231725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:39.232507 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:39.232509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.232838 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.232838 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:39.232941 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.233371 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:39.233379 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:39.234735 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:39.236062 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:39.236069 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:39.236070 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:39.236277 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:39.236470 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:39.236479 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:39.236480 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:39.236573 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:39.236853 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:39.236857 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:39.237016 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 15:07:39.237117 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 15:07:39.237302 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":96,"threads_started":1}
I20260806 15:07:39.238202 30228 heartbeater.cc:347] Connected to a master server at 127.29.69.190:41351
I20260806 15:07:39.238327 30228 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:39.238544 30228 heartbeater.cc:511] Master 127.29.69.190:41351 requested a full tablet report, sending...
I20260806 15:07:39.239106 30030 ts_manager.cc:194] Registered new tserver with Master: 85a88cce07a84a11bed76360f506802f (127.29.69.129:42229)
I20260806 15:07:39.239818 30030 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:55471
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:39.261117 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41351
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:39.362521 30233 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:39.362759 30233 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:39.362800 30233 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:39.363945 30233 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:39.364013 30233 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:39.364055 30233 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:39.365500 30233 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41351
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30233
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:39.365768 30233 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:39.365998 30233 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:39.370851 30241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:39.370879 30239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:39.370934 30233 server_base.cc:1034] running on GCE node
W20260806 15:07:39.370862 30238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:39.371356 30233 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:39.371601 30233 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:39.372740 30233 hybrid_clock.cc:648] HybridClock initialized: now 1786028859372728 us; error 28 us; skew 500 ppm
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:39.375150 30233 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:39.375656 30233 webserver.cc:460] Webserver started at http://127.29.69.130:37485/ using document root <none> and password file <none>
I20260806 15:07:39.375876 30233 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:39.375954 30233 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:39.376102 30233 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:39.377117 30233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "dff98c9e591e43d69bde37ab83a988fb"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "1cae9790d7ade6f7768d286ced2b85d1"
server_key_iv: "f3629d1f4b54c2336dbef96f2b693aaa"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.377563 30233 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "dff98c9e591e43d69bde37ab83a988fb"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "1cae9790d7ade6f7768d286ced2b85d1"
server_key_iv: "f3629d1f4b54c2336dbef96f2b693aaa"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.378991 30233 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:07:39.379678 30248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.379844 30233 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.379945 30233 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "dff98c9e591e43d69bde37ab83a988fb"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "1cae9790d7ade6f7768d286ced2b85d1"
server_key_iv: "f3629d1f4b54c2336dbef96f2b693aaa"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.380016 30233 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:39.405213 30233 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:39.407368 30233 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:39.407563 30233 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:39.407815 30233 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:39.408134 30233 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:39.408198 30233 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.408234 30233 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:39.408262 30233 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.415231 30233 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:45653
I20260806 15:07:39.415285 30369 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:45653 every 8 connection(s)
I20260806 15:07:39.415594 30233 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:39.416150 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30233
I20260806 15:07:39.416244 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:39.416447 29974 external_mini_cluster.cc:1428] Setting key 3684bdbafd87ccdd5ca70246c701affb
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
I20260806 15:07:39.426023 30072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.416440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:36445 (local address 127.29.69.190:41351)
0806 15:07:39.416517 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:39.416519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:39.416803 (+ 284us) server_negotiation.cc:407] Connection header received
0806 15:07:39.417468 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:39.417469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:39.417478 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:39.417527 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:39.418899 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.419409 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.420391 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.420685 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.420773 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.423089 (+ 2316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:39.423090 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:39.423090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:39.423098 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:39.424603 (+ 1505us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.425014 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.425015 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.425015 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.425075 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.425319 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.425320 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.425321 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.425450 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:39.425531 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:39.425832 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 15:07:39.425916 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:07:39.426159 30372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.416413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:41351 (local address 127.29.69.130:36445)
0806 15:07:39.416622 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:39.416703 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:39.417360 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:39.417601 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:39.417605 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:39.418469 (+ 864us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:39.418772 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:39.418779 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.419499 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.419499 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:39.420300 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:39.420302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.420784 (+ 482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.420786 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:39.420913 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.421435 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:39.421444 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:39.422964 (+ 1520us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:39.424697 (+ 1733us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:39.424704 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:39.424706 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:39.424944 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:39.425144 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:39.425145 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:39.425145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:39.425251 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:39.425524 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:39.425532 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:39.425666 (+ 134us) client_negotiation.cc:769] Sending connection context
0806 15:07:39.425772 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 15:07:39.425934 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":101,"threads_started":1}
I20260806 15:07:39.426694 30370 heartbeater.cc:347] Connected to a master server at 127.29.69.190:41351
I20260806 15:07:39.426831 30370 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:39.427008 30370 heartbeater.cc:511] Master 127.29.69.190:41351 requested a full tablet report, sending...
I20260806 15:07:39.427380 30030 ts_manager.cc:194] Registered new tserver with Master: dff98c9e591e43d69bde37ab83a988fb (127.29.69.130:45653)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
I20260806 15:07:39.427809 30030 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:36445
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:39.441601 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41351
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:39.538883 30375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:39.539079 30375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:39.539105 30375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:39.540253 30375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:39.540294 30375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:39.540347 30375 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:39.541951 30375 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41351
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:39.542198 30375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:39.542459 30375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:39.547868 30381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:39.547894 30384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:39.547945 30382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:39.548200 30375 server_base.cc:1034] running on GCE node
I20260806 15:07:39.548418 30375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:39.548663 30375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:39.549824 30375 hybrid_clock.cc:648] HybridClock initialized: now 1786028859549817 us; error 36 us; skew 500 ppm
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:39.553056 30375 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:39.553459 30375 webserver.cc:460] Webserver started at http://127.29.69.131:42119/ using document root <none> and password file <none>
I20260806 15:07:39.553692 30375 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:39.553761 30375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:39.553912 30375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:39.555176 30375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "ac4e681c74bf44ca8144a6d7459ca2c9"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "36dc49aa38cda8c2f856a9cbafb650f5"
server_key_iv: "dd5fa798a2d60f910fcec29cf0318606"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.555572 30375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "ac4e681c74bf44ca8144a6d7459ca2c9"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "36dc49aa38cda8c2f856a9cbafb650f5"
server_key_iv: "dd5fa798a2d60f910fcec29cf0318606"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.556983 30375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:07:39.557837 30391 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.558029 30375 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:39.558146 30375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "ac4e681c74bf44ca8144a6d7459ca2c9"
format_stamp: "Formatted at 2026-08-06 15:07:39 on dist-test-slave-tm1g"
server_key: "36dc49aa38cda8c2f856a9cbafb650f5"
server_key_iv: "dd5fa798a2d60f910fcec29cf0318606"
server_key_version: "encryptionkey@0"
I20260806 15:07:39.558220 30375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:39.579169 30375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:39.581465 30375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:39.581694 30375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:39.582074 30375 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:39.582450 30375 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:39.582506 30375 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.582540 30375 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:39.582619 30375 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:39.597184 30375 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:37055
I20260806 15:07:39.597326 30510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:37055 every 8 connection(s)
I20260806 15:07:39.597584 30375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:39.606691 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30375
I20260806 15:07:39.606777 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:39.606943 29974 external_mini_cluster.cc:1428] Setting key 1cf6638012e782e8d27c83e1859c7adf
I20260806 15:07:39.607563 30072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.598404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:42311 (local address 127.29.69.190:41351)
0806 15:07:39.598470 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:39.598473 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:39.598768 (+ 295us) server_negotiation.cc:407] Connection header received
0806 15:07:39.599305 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:39.599306 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:39.599320 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:39.599373 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:39.600300 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.600821 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.601955 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.602162 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.602248 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.604817 (+ 2569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:39.604819 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:39.604819 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:39.604825 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:39.606051 (+ 1226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.606474 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.606474 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.606475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.606528 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.606828 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.606829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.606830 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.606954 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:39.607037 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:39.607376 (+ 339us) server_negotiation.cc:299] Negotiation successful
0806 15:07:39.607460 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 15:07:39.607792 30513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.598394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:41351 (local address 127.29.69.131:42311)
0806 15:07:39.598643 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:39.598678 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:39.599190 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:39.599448 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:39.599452 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:39.600005 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:39.600200 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:39.600204 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.600915 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.600917 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:39.601857 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:39.601860 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.602259 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.602260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:39.602489 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.603159 (+ 670us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:39.603167 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:39.604730 (+ 1563us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:39.606121 (+ 1391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:39.606127 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:39.606129 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:39.606412 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:39.606592 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:39.606593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:39.606593 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:39.606744 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:39.607051 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:39.607058 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:39.607224 (+ 166us) client_negotiation.cc:769] Sending connection context
0806 15:07:39.607332 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 15:07:39.607490 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210,"thread_start_us":164,"threads_started":1}
I20260806 15:07:39.608239 30511 heartbeater.cc:347] Connected to a master server at 127.29.69.190:41351
I20260806 15:07:39.608343 30511 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:39.608520 30511 heartbeater.cc:511] Master 127.29.69.190:41351 requested a full tablet report, sending...
I20260806 15:07:39.608901 30030 ts_manager.cc:194] Registered new tserver with Master: ac4e681c74bf44ca8144a6d7459ca2c9 (127.29.69.131:37055)
I20260806 15:07:39.609284 30030 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:42311
I20260806 15:07:39.618811 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:39.644322 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.635595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46098 (local address 127.29.69.129:42229)
0806 15:07:39.635860 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:39.635872 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:39.635881 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:39.635905 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:39.635907 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:39.635920 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:39.636050 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:39.636651 (+ 601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.637586 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.638359 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.638790 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.638880 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.641194 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:39.641202 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:39.641202 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:39.641217 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:39.643027 (+ 1810us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.643368 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.643371 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.643371 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.643433 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.643644 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.643645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.643645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.643775 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:39.644035 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:39.644085 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 15:07:39.644167 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":78,"threads_started":1}
W20260806 15:07:39.644739 30139 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46098
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[29983](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028859, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:39.666548 30518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:39.659447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46104 (local address 127.29.69.129:42229)
0806 15:07:39.659506 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:39.659512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:39.659523 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:07:39.659585 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:39.659586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:39.659596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:39.659669 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:39.660161 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.660644 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.661619 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:39.661857 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:39.661914 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:39.664311 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:39.664312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:39.664313 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:39.664319 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:39.665472 (+ 1153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.665763 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.665764 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.665764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.665811 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:39.666000 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:39.666001 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:39.666001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:39.666116 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:39.666207 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:39.666377 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 15:07:39.666451 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 15:07:39.667045 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30096
I20260806 15:07:39.673326 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30233
I20260806 15:07:39.678509 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30375
I20260806 15:07:39.683161 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 29997
2026-08-06T15:07:39Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2066 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[30525](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[30525](info): set up 2 sockets
Aug 06 15:07:39 dist-test-slave-tm1g krb5kdc[30525](info): commencing operation
krb5kdc: starting...
W20260806 15:07:40.744503 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:40 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:40.860518 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42571
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:42571
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:40.940752 30538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:40.940989 30538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:40.941023 30538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:40.942165 30538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:40.942231 30538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:40.942258 30538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:40.942289 30538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:40.942335 30538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:40.943778 30538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:42571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:40.944041 30538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:40.944263 30538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:40.949061 30548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:40.949069 30546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:40.949149 30545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:40.949249 30538 server_base.cc:1034] running on GCE node
I20260806 15:07:40.949509 30538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:40.949734 30538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:40.950901 30538 hybrid_clock.cc:648] HybridClock initialized: now 1786028860950888 us; error 29 us; skew 500 ppm
Aug 06 15:07:40 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028860, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:40.953277 30538 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:40.953637 30538 webserver.cc:460] Webserver started at http://127.29.69.190:38657/ using document root <none> and password file <none>
I20260806 15:07:40.953819 30538 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:40.953856 30538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:40.953941 30538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:40.954994 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "0509715dcec14603b8e409a00b95049e"
format_stamp: "Formatted at 2026-08-06 15:07:40 on dist-test-slave-tm1g"
server_key: "3c18f19161e686455bc44851ff1e0b41"
server_key_iv: "9c205a3e9d282c6fc2a613b5ebbae9e8"
server_key_version: "encryptionkey@0"
I20260806 15:07:40.955291 30538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "0509715dcec14603b8e409a00b95049e"
format_stamp: "Formatted at 2026-08-06 15:07:40 on dist-test-slave-tm1g"
server_key: "3c18f19161e686455bc44851ff1e0b41"
server_key_iv: "9c205a3e9d282c6fc2a613b5ebbae9e8"
server_key_version: "encryptionkey@0"
I20260806 15:07:40.956578 30538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:40.957231 30556 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:40.957406 30538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:40.957494 30538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "0509715dcec14603b8e409a00b95049e"
format_stamp: "Formatted at 2026-08-06 15:07:40 on dist-test-slave-tm1g"
server_key: "3c18f19161e686455bc44851ff1e0b41"
server_key_iv: "9c205a3e9d282c6fc2a613b5ebbae9e8"
server_key_version: "encryptionkey@0"
I20260806 15:07:40.957548 30538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:40.971088 30538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:40.972749 30538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:40.972858 30538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:40.976635 30538 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:42571
I20260806 15:07:40.976680 30611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:42571 every 8 connection(s)
I20260806 15:07:40.977006 30538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:40.977875 30612 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:40.980113 30612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e: Bootstrap starting.
I20260806 15:07:40.980674 30612 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:40.980960 30612 log.cc:824] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:40.981638 30612 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e: No bootstrap required, opened a new log
I20260806 15:07:40.983247 30612 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0509715dcec14603b8e409a00b95049e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42571 } }
I20260806 15:07:40.983398 30612 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:40.983445 30612 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0509715dcec14603b8e409a00b95049e, State: Initialized, Role: FOLLOWER
I20260806 15:07:40.983603 30612 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0509715dcec14603b8e409a00b95049e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42571 } }
I20260806 15:07:40.983686 30612 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:40.983731 30612 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:40.983783 30612 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:40.984287 30612 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0509715dcec14603b8e409a00b95049e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42571 } }
I20260806 15:07:40.984402 30612 leader_election.cc:302] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0509715dcec14603b8e409a00b95049e; no voters:
I20260806 15:07:40.984581 30612 leader_election.cc:288] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:40.984618 30615 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:40.984845 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30538
I20260806 15:07:40.984951 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:40.985144 29974 external_mini_cluster.cc:1428] Setting key 1632dbbb4bccac6f71ee627bd534216b
I20260806 15:07:40.984823 30612 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:40.985466 30615 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [term 1 LEADER]: Becoming Leader. State: Replica: 0509715dcec14603b8e409a00b95049e, State: Running, Role: LEADER
I20260806 15:07:40.985662 30615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0509715dcec14603b8e409a00b95049e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42571 } }
I20260806 15:07:40.986055 30618 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0509715dcec14603b8e409a00b95049e. Latest consensus state: current_term: 1 leader_uuid: "0509715dcec14603b8e409a00b95049e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0509715dcec14603b8e409a00b95049e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42571 } } }
I20260806 15:07:40.986151 30618 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:40.986476 30627 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:40.986933 30617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0509715dcec14603b8e409a00b95049e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0509715dcec14603b8e409a00b95049e" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42571 } } }
I20260806 15:07:40.987013 30617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:40.987775 30627 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:40.989333 30627 catalog_manager.cc:1347] Generated new cluster ID: 75c1859d850e4243b6e78af4be7eb06a
I20260806 15:07:40.989387 30627 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:07:40 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:40.995661 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:40.985785 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50290 (local address 127.29.69.190:42571)
0806 15:07:40.986352 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:40.986363 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:40.986402 (+ 39us) server_negotiation.cc:407] Connection header received
0806 15:07:40.986515 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:40.986522 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:40.986577 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:40.986729 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:40.987437 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:40.988600 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:40.989568 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:40.990012 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:40.990131 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:40.992410 (+ 2279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:40.992413 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:40.992414 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:40.992425 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:40.994136 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:40.994543 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:40.994546 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:40.994547 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:40.994650 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:40.994868 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:40.994869 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:40.994869 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:40.995096 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:40.995268 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:40.995335 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 15:07:40.995474 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":69,"threads_started":1}
I20260806 15:07:41.001538 30627 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:41.002071 30627 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:41.005932 30627 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0509715dcec14603b8e409a00b95049e: Generated new TSK 0
I20260806 15:07:41.006130 30627 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:41.035241 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42571
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:41.123100 30639 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:41.123293 30639 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:41.123317 30639 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:41.124464 30639 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:41.124538 30639 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:41.124570 30639 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:41.126071 30639 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42571
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30639
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:41.126297 30639 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:41.126573 30639 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:41.132198 30645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:41.132207 30644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:41.132207 30648 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:41.132809 30639 server_base.cc:1034] running on GCE node
I20260806 15:07:41.133033 30639 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:41.133272 30639 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:41.134445 30639 hybrid_clock.cc:648] HybridClock initialized: now 1786028861134417 us; error 45 us; skew 500 ppm
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:41.136930 30639 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:41.137293 30639 webserver.cc:460] Webserver started at http://127.29.69.129:43303/ using document root <none> and password file <none>
I20260806 15:07:41.137494 30639 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:41.137542 30639 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:41.137624 30639 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:41.138651 30639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "92082629896643b3a820e5e3fb9cfdee"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "1745d9f94bcc762ec4e708a47c9efc9c"
server_key_iv: "b42c48c3f34f94a2281c0215c8a679c6"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.139007 30639 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "92082629896643b3a820e5e3fb9cfdee"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "1745d9f94bcc762ec4e708a47c9efc9c"
server_key_iv: "b42c48c3f34f94a2281c0215c8a679c6"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.140278 30639 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:41.140909 30655 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.141103 30639 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:41.141168 30639 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "92082629896643b3a820e5e3fb9cfdee"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "1745d9f94bcc762ec4e708a47c9efc9c"
server_key_iv: "b42c48c3f34f94a2281c0215c8a679c6"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.141258 30639 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:41.149677 30639 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:41.152047 30639 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:41.152248 30639 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:41.152537 30639 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:41.152845 30639 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:41.152881 30639 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.152902 30639 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:41.152915 30639 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.158845 30639 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:37957
I20260806 15:07:41.158902 30774 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:37957 every 8 connection(s)
I20260806 15:07:41.159217 30639 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:41.160158 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30639
I20260806 15:07:41.160262 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:41.160427 29974 external_mini_cluster.cc:1428] Setting key 3d6ff3d361e65c04eecd228e56b4d6b6
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
I20260806 15:07:41.169838 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.159950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:38997 (local address 127.29.69.190:42571)
0806 15:07:41.160023 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.160026 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.160200 (+ 174us) server_negotiation.cc:407] Connection header received
0806 15:07:41.161483 (+ 1283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.161484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.161496 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.161568 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.162112 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.162801 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.164045 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.164256 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.164330 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.166940 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.166941 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.166942 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.166948 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.168441 (+ 1493us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.168838 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.168839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.168840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.168898 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.169153 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.169154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.169154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.169285 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.169349 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.169704 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.169774 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:07:41.169974 30777 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.159905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42571 (local address 127.29.69.129:38997)
0806 15:07:41.160063 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.160103 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.161377 (+ 1274us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.161618 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.161621 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.161845 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:41.162024 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.162027 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.162906 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.162908 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.163928 (+ 1020us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.163931 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.164338 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.164339 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.164627 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.165238 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:41.165245 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:41.166834 (+ 1589us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:41.168536 (+ 1702us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:41.168544 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:41.168546 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:41.168759 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:41.168973 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:41.168974 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:41.168974 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:41.169080 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:41.169359 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:41.169368 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:41.169547 (+ 179us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.169668 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.169789 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":114,"threads_started":1}
I20260806 15:07:41.170598 30775 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42571
I20260806 15:07:41.170679 30775 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:41.170871 30775 heartbeater.cc:511] Master 127.29.69.190:42571 requested a full tablet report, sending...
I20260806 15:07:41.171454 30575 ts_manager.cc:194] Registered new tserver with Master: 92082629896643b3a820e5e3fb9cfdee (127.29.69.129:37957)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
I20260806 15:07:41.172310 30575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:38997
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:41.188496 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42571
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:41.301915 30780 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:41.302116 30780 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:41.302142 30780 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:41.303427 30780 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:41.303468 30780 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:41.303522 30780 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:41.305183 30780 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42571
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30780
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:41.305379 30780 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:41.305563 30780 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:41.311028 30785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:41.311019 30786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:41.311002 30788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:41.311420 30780 server_base.cc:1034] running on GCE node
I20260806 15:07:41.311637 30780 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:41.311866 30780 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:41.313032 30780 hybrid_clock.cc:648] HybridClock initialized: now 1786028861313019 us; error 25 us; skew 500 ppm
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:41.316335 30780 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:41.316815 30780 webserver.cc:460] Webserver started at http://127.29.69.130:38823/ using document root <none> and password file <none>
I20260806 15:07:41.317050 30780 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:41.317119 30780 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:41.317274 30780 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:41.318588 30780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "1e265625907e4a408f1a05907ff70b1d"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "75efbc23e9bbf7d671d38979c765df88"
server_key_iv: "3b1a56ceab995fa11610d4f539bda230"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.318985 30780 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "1e265625907e4a408f1a05907ff70b1d"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "75efbc23e9bbf7d671d38979c765df88"
server_key_iv: "3b1a56ceab995fa11610d4f539bda230"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.320371 30780 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:41.321332 30796 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.321524 30780 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:41.321630 30780 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "1e265625907e4a408f1a05907ff70b1d"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "75efbc23e9bbf7d671d38979c765df88"
server_key_iv: "3b1a56ceab995fa11610d4f539bda230"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.321703 30780 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:41.344512 30780 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:41.346933 30780 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:41.347164 30780 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:41.347568 30780 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:41.347962 30780 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:41.348021 30780 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.348066 30780 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:41.348091 30780 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.364420 30780 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:34209
I20260806 15:07:41.364547 30914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:34209 every 8 connection(s)
I20260806 15:07:41.365026 30780 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:41.373992 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30780
I20260806 15:07:41.374097 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:41.374279 29974 external_mini_cluster.cc:1428] Setting key 5fc59609c391ddfc5bf9a353ed4ff5a2
I20260806 15:07:41.376328 30917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.366049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42571 (local address 127.29.69.130:37565)
0806 15:07:41.366259 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.366340 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.367604 (+ 1264us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.367873 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.367877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.368230 (+ 353us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:41.368529 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.368534 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.369274 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.369275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.370271 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.370273 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.370743 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.370744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.370963 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.371525 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:41.371533 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:41.373019 (+ 1486us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:41.374790 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:41.374797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:41.374799 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:41.375109 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:41.375334 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:41.375334 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:41.375335 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:41.375438 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:41.375804 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:41.375809 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:41.375925 (+ 116us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.376004 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.376118 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":82,"threads_started":1}
I20260806 15:07:41.376332 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.366255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:37565 (local address 127.29.69.190:42571)
0806 15:07:41.366344 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.366347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.366469 (+ 122us) server_negotiation.cc:407] Connection header received
0806 15:07:41.367725 (+ 1256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.367726 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.367739 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.367792 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.368633 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.369173 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.370428 (+ 1255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.370644 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.370731 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.373111 (+ 2380us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.373113 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.373113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.373119 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.374714 (+ 1595us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.375183 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.375184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.375184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.375249 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.375504 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.375505 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.375505 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.375720 (+ 215us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.375817 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.376063 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.376193 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:07:41.376977 30915 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42571
I20260806 15:07:41.377087 30915 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:41.377264 30915 heartbeater.cc:511] Master 127.29.69.190:42571 requested a full tablet report, sending...
I20260806 15:07:41.377661 30575 ts_manager.cc:194] Registered new tserver with Master: 1e265625907e4a408f1a05907ff70b1d (127.29.69.130:34209)
I20260806 15:07:41.378044 30575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:37565
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:41.401059 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42571
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:36121
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:41.519526 30920 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:41.519713 30920 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:41.519737 30920 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:41.521136 30920 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:41.521180 30920 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:41.521207 30920 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:41.522869 30920 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:36121
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42571
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30920
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:41.523067 30920 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:41.523248 30920 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:41.529211 30925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:41.529264 30926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:41.529247 30928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:41.529412 30920 server_base.cc:1034] running on GCE node
I20260806 15:07:41.529652 30920 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:41.529891 30920 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:41.531049 30920 hybrid_clock.cc:648] HybridClock initialized: now 1786028861531036 us; error 30 us; skew 500 ppm
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:41.534209 30920 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:41.534708 30920 webserver.cc:460] Webserver started at http://127.29.69.131:34407/ using document root <none> and password file <none>
I20260806 15:07:41.534904 30920 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:41.534945 30920 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:41.535030 30920 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:41.536156 30920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "6baf970d0bdb4c14a7ad85a5e397a738"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "1e6d4d3a24e301fd31a67b664d187d02"
server_key_iv: "ebe9a89c25d8ca32758f1da62b3dd0d2"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.536566 30920 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "6baf970d0bdb4c14a7ad85a5e397a738"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "1e6d4d3a24e301fd31a67b664d187d02"
server_key_iv: "ebe9a89c25d8ca32758f1da62b3dd0d2"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.538066 30920 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:07:41.538938 30935 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.539148 30920 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:07:41.539223 30920 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "6baf970d0bdb4c14a7ad85a5e397a738"
format_stamp: "Formatted at 2026-08-06 15:07:41 on dist-test-slave-tm1g"
server_key: "1e6d4d3a24e301fd31a67b664d187d02"
server_key_iv: "ebe9a89c25d8ca32758f1da62b3dd0d2"
server_key_version: "encryptionkey@0"
I20260806 15:07:41.539273 30920 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:41.554073 30920 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:41.556571 30920 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:41.556852 30920 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:41.557188 30920 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:41.557510 30920 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:41.557543 30920 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.557564 30920 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:41.557577 30920 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:41.569773 30920 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:38313
I20260806 15:07:41.569830 31056 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:38313 every 8 connection(s)
I20260806 15:07:41.570127 30920 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:41.577030 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 30920
I20260806 15:07:41.577128 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:41.577318 29974 external_mini_cluster.cc:1428] Setting key 344767100ec92bd71b8c514c67325728
I20260806 15:07:41.579361 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.570839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:42353 (local address 127.29.69.190:42571)
0806 15:07:41.570911 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.570913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.571153 (+ 240us) server_negotiation.cc:407] Connection header received
0806 15:07:41.572080 (+ 927us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.572081 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.572093 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.572153 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.572707 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.573203 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.574159 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.574428 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.574484 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.576382 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.576383 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.576384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.576390 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.577970 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.578394 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.578395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.578396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.578455 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.578715 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.578716 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.578716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.578831 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.578924 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.579190 (+ 266us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.579269 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 15:07:41.579564 31059 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.570832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42571 (local address 127.29.69.131:42353)
0806 15:07:41.571019 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.571060 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.571950 (+ 890us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.572207 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.572210 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.572441 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:41.572631 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.572635 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.573280 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.573281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.574076 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.574078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.574499 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.574500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.574609 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.575007 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:41.575015 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:41.576303 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:41.578054 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:41.578061 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:41.578063 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:41.578284 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:41.578529 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:41.578530 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:41.578531 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:41.578638 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:41.578917 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:41.578923 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:41.579058 (+ 135us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.579167 (+ 109us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.579324 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":88,"threads_started":1}
I20260806 15:07:41.579953 31057 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42571
I20260806 15:07:41.580046 31057 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:41.580233 31057 heartbeater.cc:511] Master 127.29.69.190:42571 requested a full tablet report, sending...
I20260806 15:07:41.580603 30575 ts_manager.cc:194] Registered new tserver with Master: 6baf970d0bdb4c14a7ad85a5e397a738 (127.29.69.131:38313)
I20260806 15:07:41.580982 30575 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:42353
I20260806 15:07:41.588913 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:07:41.596637 30622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.590637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50292 (local address 127.29.69.190:42571)
0806 15:07:41.590726 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.590728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.590831 (+ 103us) server_negotiation.cc:407] Connection header received
0806 15:07:41.590897 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.590898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.590908 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.590969 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.591509 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.591979 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.592712 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.592934 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.593024 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.594198 (+ 1174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.594200 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.594200 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.594207 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.595468 (+ 1261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.595823 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.595824 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.595824 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.595881 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.596086 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.596087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.596088 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.596237 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.596350 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.596453 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.596534 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260806 15:07:41.598734 30575 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50292:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:41.600313 30575 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:41.607255 31068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.603060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:37957 (local address 127.0.0.1:53208)
0806 15:07:41.603219 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.603256 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.603329 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.603786 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.603787 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.603788 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:41.603818 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.603819 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.604728 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.604729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.606050 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.606062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.606953 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.606954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.607034 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.607053 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.607123 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.607187 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":29,"thread_start_us":98,"threads_started":1}
I20260806 15:07:41.607262 31073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.603423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53208 (local address 127.29.69.129:37957)
0806 15:07:41.603608 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.603612 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.603623 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:07:41.603692 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.603694 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.603710 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.603791 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:41.603877 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.604624 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.606152 (+ 1528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.606885 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.606954 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.607017 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.607142 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.607183 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":80,"threads_started":1}
I20260806 15:07:41.607309 31072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.603379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38356 (local address 127.29.69.130:34209)
0806 15:07:41.603571 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.603576 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.603585 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:41.603624 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.603626 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.603642 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.603721 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:41.603927 (+ 206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.604598 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.605928 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.606695 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.606775 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.606896 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.607180 (+ 284us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.607228 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":119,"threads_started":1}
I20260806 15:07:41.607533 31069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.603060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:34209 (local address 127.0.0.1:38356)
0806 15:07:41.603428 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.603437 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.603476 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.603736 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.603739 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.603742 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:41.603815 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.603816 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.604702 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.604703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.605845 (+ 1142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.605847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.606929 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.606930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.607032 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.607050 (+ 18us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.607122 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.607479 (+ 357us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":356,"thread_start_us":89,"threads_started":1}
I20260806 15:07:41.608019 30706 tablet_service.cc:1467] Processing CreateTablet for tablet c72aee4e021f4bac9e4ae0faa9373731 (DEFAULT_TABLE table=test-table [id=298469e1660946558f645b1621eab77a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:41.608399 30706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72aee4e021f4bac9e4ae0faa9373731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:41.608333 30846 tablet_service.cc:1467] Processing CreateTablet for tablet c72aee4e021f4bac9e4ae0faa9373731 (DEFAULT_TABLE table=test-table [id=298469e1660946558f645b1621eab77a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:41.608645 30846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72aee4e021f4bac9e4ae0faa9373731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:41.611023 31070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.603050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38313 (local address 127.0.0.1:56078)
0806 15:07:41.603218 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.603256 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.603323 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.604971 (+ 1648us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.604972 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.604974 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:41.605021 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.605022 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.606212 (+ 1190us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.606213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.607096 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.607098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.610822 (+ 3724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.610823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.610893 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.610897 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.610930 (+ 33us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.610968 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":58,"threads_started":1}
I20260806 15:07:41.611373 31071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.603231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56078 (local address 127.29.69.131:38313)
0806 15:07:41.604815 (+ 1584us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.604819 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.604827 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:07:41.604864 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.604866 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.604881 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.604960 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:41.605083 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.606128 (+ 1045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.607185 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.610726 (+ 3541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.611146 (+ 420us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.611215 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.611245 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.611293 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1546,"thread_start_us":82,"threads_started":1}
I20260806 15:07:41.611905 31075 tablet_bootstrap.cc:492] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: Bootstrap starting.
I20260806 15:07:41.612042 30986 tablet_service.cc:1467] Processing CreateTablet for tablet c72aee4e021f4bac9e4ae0faa9373731 (DEFAULT_TABLE table=test-table [id=298469e1660946558f645b1621eab77a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:41.612180 31076 tablet_bootstrap.cc:492] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: Bootstrap starting.
I20260806 15:07:41.612387 30986 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c72aee4e021f4bac9e4ae0faa9373731. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:41.612661 31075 tablet_bootstrap.cc:654] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:41.612838 31076 tablet_bootstrap.cc:654] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:41.613255 31075 log.cc:824] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:41.613304 31076 log.cc:824] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:41.614105 31076 tablet_bootstrap.cc:492] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: No bootstrap required, opened a new log
I20260806 15:07:41.614105 31075 tablet_bootstrap.cc:492] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: No bootstrap required, opened a new log
I20260806 15:07:41.614176 31075 ts_tablet_manager.cc:1397] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:07:41.614240 31076 ts_tablet_manager.cc:1397] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:07:41.615458 31079 tablet_bootstrap.cc:492] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: Bootstrap starting.
I20260806 15:07:41.615945 31079 tablet_bootstrap.cc:654] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:41.616230 31075 raft_consensus.cc:348] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.616412 31075 raft_consensus.cc:374] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:41.616421 31079 log.cc:824] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:41.616447 31075 raft_consensus.cc:729] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92082629896643b3a820e5e3fb9cfdee, State: Initialized, Role: FOLLOWER
I20260806 15:07:41.616384 31076 raft_consensus.cc:348] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.616532 31076 raft_consensus.cc:374] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:41.616567 31076 raft_consensus.cc:729] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e265625907e4a408f1a05907ff70b1d, State: Initialized, Role: FOLLOWER
I20260806 15:07:41.616585 31075 consensus_queue.cc:260] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.616688 31076 consensus_queue.cc:260] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.616881 30775 heartbeater.cc:503] Master 127.29.69.190:42571 was elected leader, sending a full tablet report...
I20260806 15:07:41.616942 31076 ts_tablet_manager.cc:1428] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 15:07:41.617070 30915 heartbeater.cc:503] Master 127.29.69.190:42571 was elected leader, sending a full tablet report...
I20260806 15:07:41.617107 31079 tablet_bootstrap.cc:492] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: No bootstrap required, opened a new log
I20260806 15:07:41.617159 31079 ts_tablet_manager.cc:1397] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:41.617420 31075 ts_tablet_manager.cc:1428] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:41.619006 31079 raft_consensus.cc:348] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.619156 31079 raft_consensus.cc:374] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:41.619203 31079 raft_consensus.cc:729] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6baf970d0bdb4c14a7ad85a5e397a738, State: Initialized, Role: FOLLOWER
I20260806 15:07:41.619311 31079 consensus_queue.cc:260] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.619590 31057 heartbeater.cc:503] Master 127.29.69.190:42571 was elected leader, sending a full tablet report...
I20260806 15:07:41.619587 31079 ts_tablet_manager.cc:1428] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260806 15:07:41.659986 30776 tablet.cc:2369] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:07:41.820783 31058 tablet.cc:2369] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:41.858486 31081 raft_consensus.cc:482] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:41.858660 31081 raft_consensus.cc:504] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.859048 31081 leader_election.cc:288] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6baf970d0bdb4c14a7ad85a5e397a738 (127.29.69.131:38313), 1e265625907e4a408f1a05907ff70b1d (127.29.69.130:34209)
I20260806 15:07:41.862246 31071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.859516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:56081 (local address 127.29.69.131:38313)
0806 15:07:41.859564 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.859581 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.859618 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:07:41.859652 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.859653 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.859662 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.859715 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:41.859890 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.860402 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.861490 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.861892 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.861947 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.861954 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.862127 (+ 173us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.862179 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:07:41.862251 31085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.859317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38313 (local address 127.29.69.129:56081)
0806 15:07:41.859473 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.859484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.859574 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.859730 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.859731 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.859732 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:41.859811 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.859815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.860487 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.860488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.861395 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.861398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.861974 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.861976 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.862047 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.862052 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.862110 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.862139 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":47,"thread_start_us":78,"threads_started":1}
I20260806 15:07:41.862355 31072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.859391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:40789 (local address 127.29.69.130:34209)
0806 15:07:41.859442 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.859445 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.859567 (+ 122us) server_negotiation.cc:407] Connection header received
0806 15:07:41.859658 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.859660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.859670 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.859702 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:41.859974 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.860482 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.861548 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.861919 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.862010 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.862019 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.862200 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.862247 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:07:41.862565 31084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.859300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:34209 (local address 127.29.69.129:40789)
0806 15:07:41.859455 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:41.859467 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:41.859561 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:41.859782 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:41.859783 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:41.859785 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:41.859898 (+ 113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.859900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.860572 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.860573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.861427 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:41.861430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.862035 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.862035 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:41.862119 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.862123 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:41.862181 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 15:07:41.862218 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":2,"thread_start_us":87,"threads_started":1}
I20260806 15:07:41.862648 31008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c72aee4e021f4bac9e4ae0faa9373731" candidate_uuid: "92082629896643b3a820e5e3fb9cfdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" is_pre_election: true
I20260806 15:07:41.862857 31008 raft_consensus.cc:2454] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92082629896643b3a820e5e3fb9cfdee in term 0.
I20260806 15:07:41.862919 30867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c72aee4e021f4bac9e4ae0faa9373731" candidate_uuid: "92082629896643b3a820e5e3fb9cfdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e265625907e4a408f1a05907ff70b1d" is_pre_election: true
I20260806 15:07:41.863093 30658 leader_election.cc:302] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6baf970d0bdb4c14a7ad85a5e397a738, 92082629896643b3a820e5e3fb9cfdee; no voters:
I20260806 15:07:41.863129 30867 raft_consensus.cc:2454] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 92082629896643b3a820e5e3fb9cfdee in term 0.
I20260806 15:07:41.863255 31081 raft_consensus.cc:2781] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:41.863320 31081 raft_consensus.cc:482] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:41.863360 31081 raft_consensus.cc:3037] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:41.864102 31081 raft_consensus.cc:504] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
I20260806 15:07:41.864254 31081 leader_election.cc:288] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [CANDIDATE]: Term 1 election: Requested vote from peers 6baf970d0bdb4c14a7ad85a5e397a738 (127.29.69.131:38313), 1e265625907e4a408f1a05907ff70b1d (127.29.69.130:34209)
I20260806 15:07:41.864415 31008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c72aee4e021f4bac9e4ae0faa9373731" candidate_uuid: "92082629896643b3a820e5e3fb9cfdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6baf970d0bdb4c14a7ad85a5e397a738"
I20260806 15:07:41.864480 30867 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c72aee4e021f4bac9e4ae0faa9373731" candidate_uuid: "92082629896643b3a820e5e3fb9cfdee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e265625907e4a408f1a05907ff70b1d"
I20260806 15:07:41.864497 31008 raft_consensus.cc:3037] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:41.864579 30867 raft_consensus.cc:3037] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:41.865257 31008 raft_consensus.cc:2454] T c72aee4e021f4bac9e4ae0faa9373731 P 6baf970d0bdb4c14a7ad85a5e397a738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92082629896643b3a820e5e3fb9cfdee in term 1.
I20260806 15:07:41.865305 30867 raft_consensus.cc:2454] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 92082629896643b3a820e5e3fb9cfdee in term 1.
I20260806 15:07:41.865494 30657 leader_election.cc:302] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e265625907e4a408f1a05907ff70b1d, 92082629896643b3a820e5e3fb9cfdee; no voters:
I20260806 15:07:41.865585 31081 raft_consensus.cc:2781] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:41.865731 31081 raft_consensus.cc:686] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [term 1 LEADER]: Becoming Leader. State: Replica: 92082629896643b3a820e5e3fb9cfdee, State: Running, Role: LEADER
I20260806 15:07:41.865830 31081 consensus_queue.cc:237] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } }
W20260806 15:07:41.866276 30916 tablet.cc:2369] T c72aee4e021f4bac9e4ae0faa9373731 P 1e265625907e4a408f1a05907ff70b1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:41.866668 30574 catalog_manager.cc:5495] T c72aee4e021f4bac9e4ae0faa9373731 P 92082629896643b3a820e5e3fb9cfdee reported cstate change: term changed from 0 to 1, leader changed from <none> to 92082629896643b3a820e5e3fb9cfdee (127.29.69.129). New cstate: current_term: 1 leader_uuid: "92082629896643b3a820e5e3fb9cfdee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6baf970d0bdb4c14a7ad85a5e397a738" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38313 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "92082629896643b3a820e5e3fb9cfdee" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 37957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e265625907e4a408f1a05907ff70b1d" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 34209 } health_report { overall_health: UNKNOWN } } }
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028860, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:41.892336 31073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.884348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53214 (local address 127.29.69.129:37957)
0806 15:07:41.884413 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.884415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.884532 (+ 117us) server_negotiation.cc:407] Connection header received
0806 15:07:41.884614 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.884615 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.884631 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.884694 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.885329 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.885860 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.886709 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.886946 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.887026 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.889228 (+ 2202us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.889239 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.889239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.889247 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.890974 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.891347 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.891350 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.891350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.891471 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.891686 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.891687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.891688 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.891904 (+ 216us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.892114 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.892153 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.892230 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:41.914712 31073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.907939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53222 (local address 127.29.69.129:37957)
0806 15:07:41.907999 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.908000 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.908080 (+ 80us) server_negotiation.cc:407] Connection header received
0806 15:07:41.908125 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.908126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.908134 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.908180 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.908669 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.909132 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.909801 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.909975 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.910024 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.912270 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.912272 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.912272 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.912279 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.913543 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.913883 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.913884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.913885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.913939 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.914140 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.914141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.914141 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.914237 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.914363 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.914533 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.914610 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 15:07:41 dist-test-slave-tm1g krb5kdc[30525](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028861, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:41.936522 31073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:41.929316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53230 (local address 127.29.69.129:37957)
0806 15:07:41.929416 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:41.929419 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:41.929493 (+ 74us) server_negotiation.cc:407] Connection header received
0806 15:07:41.929583 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:41.929584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:41.929595 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:41.929653 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:41.930183 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.930740 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.931464 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:41.931679 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:41.931755 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:41.934059 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:41.934061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:41.934061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:41.934068 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:41.935264 (+ 1196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.935598 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.935599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.935600 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.935661 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:41.935920 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:41.935921 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:41.935921 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:41.936024 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:41.936215 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:41.936332 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 15:07:41.936413 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
W20260806 15:07:41.937044 30685 tablet_service.cc:2908] Rejecting scan request for tablet c72aee4e021f4bac9e4ae0faa9373731: Uninitialized: clean time has not yet been initialized
I20260806 15:07:41.937841 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30639
I20260806 15:07:41.946053 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30780
I20260806 15:07:41.951090 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30920
I20260806 15:07:41.956038 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 30538
2026-08-06T15:07:41Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2272 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:42 dist-test-slave-tm1g krb5kdc[31101](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:42 dist-test-slave-tm1g krb5kdc[31101](info): set up 2 sockets
Aug 06 15:07:42 dist-test-slave-tm1g krb5kdc[31101](info): commencing operation
krb5kdc: starting...
W20260806 15:07:42.998184 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:43.113003 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:39015
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:39015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:43.192345 31115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:43.192544 31115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:43.192566 31115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:43.193615 31115 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:43.193647 31115 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 15:07:43.193660 31115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:43.193673 31115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:43.193686 31115 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:43.193697 31115 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:43.195070 31115 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:39015
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:39015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:43.195251 31115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:43.195417 31115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:43.200130 31120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:43.200206 31121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.200165 31115 server_base.cc:1034] running on GCE node
W20260806 15:07:43.200280 31124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.200676 31115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:43.200914 31115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:43.202099 31115 hybrid_clock.cc:648] HybridClock initialized: now 1786028863202076 us; error 42 us; skew 500 ppm
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:43.208115 31115 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:43.208549 31115 webserver.cc:460] Webserver started at http://127.29.69.190:38619/ using document root <none> and password file <none>
I20260806 15:07:43.208725 31115 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:43.208763 31115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:43.208848 31115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:43.209805 31115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "a55f565e34094815ac329a24158355ba"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "203d063cd967dc77089da6b932181eb7"
server_key_iv: "1e40ef83d2e1c03d5e3d43931c8b99d1"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.210116 31115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "a55f565e34094815ac329a24158355ba"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "203d063cd967dc77089da6b932181eb7"
server_key_iv: "1e40ef83d2e1c03d5e3d43931c8b99d1"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.211462 31115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:43.212113 31131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.212301 31115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:43.212402 31115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "a55f565e34094815ac329a24158355ba"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "203d063cd967dc77089da6b932181eb7"
server_key_iv: "1e40ef83d2e1c03d5e3d43931c8b99d1"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.212476 31115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:43.228188 31115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:43.230082 31115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:43.230240 31115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:43.235153 31115 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:39015
I20260806 15:07:43.235215 31196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:39015 every 8 connection(s)
I20260806 15:07:43.235651 31115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:43.236346 31197 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.237346 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 31115
I20260806 15:07:43.237454 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:43.237630 29974 external_mini_cluster.cc:1428] Setting key 0a172c16f34df65d22b78c931832349d
I20260806 15:07:43.239078 31197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: Bootstrap starting.
I20260806 15:07:43.239730 31197 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.240056 31197 log.cc:824] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:43.240869 31197 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: No bootstrap required, opened a new log
I20260806 15:07:43.243160 31197 raft_consensus.cc:348] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55f565e34094815ac329a24158355ba" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39015 } }
I20260806 15:07:43.243299 31197 raft_consensus.cc:374] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.243322 31197 raft_consensus.cc:729] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a55f565e34094815ac329a24158355ba, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.243470 31197 consensus_queue.cc:260] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55f565e34094815ac329a24158355ba" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39015 } }
I20260806 15:07:43.243543 31197 raft_consensus.cc:388] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:43.243566 31197 raft_consensus.cc:482] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:43.243633 31197 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:43.244155 31197 raft_consensus.cc:504] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55f565e34094815ac329a24158355ba" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39015 } }
I20260806 15:07:43.244282 31197 leader_election.cc:302] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a55f565e34094815ac329a24158355ba; no voters:
I20260806 15:07:43.244470 31197 leader_election.cc:288] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:43.244520 31202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:43.244690 31202 raft_consensus.cc:686] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [term 1 LEADER]: Becoming Leader. State: Replica: a55f565e34094815ac329a24158355ba, State: Running, Role: LEADER
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:43.244751 31197 sys_catalog.cc:564] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:43.244859 31202 consensus_queue.cc:237] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55f565e34094815ac329a24158355ba" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39015 } }
I20260806 15:07:43.246160 31203 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a55f565e34094815ac329a24158355ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55f565e34094815ac329a24158355ba" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39015 } } }
I20260806 15:07:43.246256 31203 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:43.246399 31204 sys_catalog.cc:455] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader a55f565e34094815ac329a24158355ba. Latest consensus state: current_term: 1 leader_uuid: "a55f565e34094815ac329a24158355ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a55f565e34094815ac329a24158355ba" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39015 } } }
I20260806 15:07:43.246774 31204 sys_catalog.cc:458] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba [sys.catalog]: This master's current role is: LEADER
W20260806 15:07:43.246999 31217 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:07:43.247054 31217 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:07:43.247098 31218 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:43.247252 31218 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:43.248879 31218 catalog_manager.cc:1347] Generated new cluster ID: bf6ccac7d03f4e1394ffa39b808f54cb
I20260806 15:07:43.248931 31218 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:07:43.250809 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.238159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52742 (local address 127.29.69.190:39015)
0806 15:07:43.238379 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.238389 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.238422 (+ 33us) server_negotiation.cc:407] Connection header received
0806 15:07:43.238942 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.238951 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.239010 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.239168 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.239753 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.241096 (+ 1343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.241841 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.242580 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.242695 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.245371 (+ 2676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.245374 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.245375 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.245386 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.247533 (+ 2147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.247939 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.247942 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.247942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.248042 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.248285 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.248286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.248287 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.248601 (+ 314us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.248736 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.250471 (+ 1735us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.250600 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":84,"threads_started":1}
I20260806 15:07:43.258265 31218 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:43.258988 31218 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:43.267340 31218 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: Generated new TSK 0
I20260806 15:07:43.267530 31218 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:43.299304 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39015
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:43.398752 31223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:43.399004 31223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:43.399044 31223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:43.400188 31223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:43.400260 31223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:43.400297 31223 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:07:43.400352 31223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:43.401747 31223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:39015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:43.401996 31223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:43.402220 31223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:43.407881 31230 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:43.407902 31231 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:43.407903 31233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.408074 31223 server_base.cc:1034] running on GCE node
I20260806 15:07:43.408356 31223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:43.408582 31223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:43.409741 31223 hybrid_clock.cc:648] HybridClock initialized: now 1786028863409726 us; error 44 us; skew 500 ppm
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:43.412382 31223 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:43.412748 31223 webserver.cc:460] Webserver started at http://127.29.69.129:38331/ using document root <none> and password file <none>
I20260806 15:07:43.412920 31223 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:43.412958 31223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:43.413055 31223 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:43.414006 31223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "104ecb9a63ed402c804e87d67a39c1bb"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "1329d40791c1842f89ee0bff37299311"
server_key_iv: "647871bc81e2cc62d47fcb22f577e0e6"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.414434 31223 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "104ecb9a63ed402c804e87d67a39c1bb"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "1329d40791c1842f89ee0bff37299311"
server_key_iv: "647871bc81e2cc62d47fcb22f577e0e6"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.415928 31223 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:43.416646 31240 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.416810 31223 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:43.416913 31223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "104ecb9a63ed402c804e87d67a39c1bb"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "1329d40791c1842f89ee0bff37299311"
server_key_iv: "647871bc81e2cc62d47fcb22f577e0e6"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.416983 31223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:43.429947 31223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:43.432212 31223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:43.432372 31223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:43.432844 31223 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:43.432901 31223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.432940 31223 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:43.432994 31223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.440023 31223 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:44331
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:43.440125 31357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:44331 every 8 connection(s)
I20260806 15:07:43.440399 31223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:43.443183 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.433470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:35611 (local address 127.29.69.190:39015)
0806 15:07:43.433518 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.433520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.433756 (+ 236us) server_negotiation.cc:407] Connection header received
0806 15:07:43.434340 (+ 584us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.434341 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.434355 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.434425 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.435311 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.436153 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.437731 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.438080 (+ 349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.438170 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.440578 (+ 2408us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.440579 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.440580 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.440588 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.442018 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.442422 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.442423 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.442423 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.442473 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.442689 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.442690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.442690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.442788 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.442838 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.443056 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.443120 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:43.443380 31249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.433464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.29.69.129:35611)
0806 15:07:43.433637 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.433671 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.434153 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.434524 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.434528 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.434932 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:43.435217 (+ 285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.435223 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.436252 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.436253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.437622 (+ 1369us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.437626 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.438171 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.438172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.438267 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.438832 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:43.438843 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:43.440493 (+ 1650us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:43.442092 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.442097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.442099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.442352 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.442538 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.442539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.442539 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.442635 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.442842 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:43.442846 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:43.442955 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.443032 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.443153 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
I20260806 15:07:43.443871 31358 heartbeater.cc:347] Connected to a master server at 127.29.69.190:39015
I20260806 15:07:43.443945 31358 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:43.444132 31358 heartbeater.cc:511] Master 127.29.69.190:39015 requested a full tablet report, sending...
I20260806 15:07:43.444598 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 31223
I20260806 15:07:43.444713 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:43.444898 29974 external_mini_cluster.cc:1428] Setting key 3903fe2dbbebae05a3c421d51d03b93b
I20260806 15:07:43.445284 31147 ts_manager.cc:194] Registered new tserver with Master: 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331)
I20260806 15:07:43.446033 31147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:35611
I20260806 15:07:43.451326 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.445030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:54413 (local address 127.29.69.190:39015)
0806 15:07:43.445084 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.445086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.445408 (+ 322us) server_negotiation.cc:407] Connection header received
0806 15:07:43.445429 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.445429 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.445439 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.445486 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.445916 (+ 430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.446677 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.447575 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.447780 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.447864 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.448812 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.448813 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.448813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.448819 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.450190 (+ 1371us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.450629 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.450630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.450630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.450679 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.450893 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.450893 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.450894 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.450987 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.451034 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.451211 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.451269 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:07:43.451418 31366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.444965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.29.69.129:54413)
0806 15:07:43.445109 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.445118 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.445192 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.445535 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.445536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.445760 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:43.445830 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.445832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.446792 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.446793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.447470 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.447472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.447866 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.447867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.447948 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.448319 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:43.448324 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:43.448727 (+ 403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:43.450275 (+ 1548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.450276 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.450277 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.450553 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.450746 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.450748 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.450748 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.450825 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.451051 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:43.451053 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:43.451109 (+ 56us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.451197 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.451301 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":77,"threads_started":1}
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:43.469000 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39015
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:43.550252 31369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:43.550519 31369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:43.550544 31369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:43.551647 31369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:43.551683 31369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:43.551702 31369 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:07:43.551719 31369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:43.553164 31369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:39015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:43.553344 31369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:43.553509 31369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:43.558444 31377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.558606 31369 server_base.cc:1034] running on GCE node
W20260806 15:07:43.558459 31374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:43.558487 31375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.558940 31369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:43.559227 31369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:43.560411 31369 hybrid_clock.cc:648] HybridClock initialized: now 1786028863560396 us; error 42 us; skew 500 ppm
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:43.562856 31369 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:43.563272 31369 webserver.cc:460] Webserver started at http://127.29.69.130:42395/ using document root <none> and password file <none>
I20260806 15:07:43.563510 31369 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:43.563581 31369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:43.563719 31369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:43.564714 31369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "31d26f6c13b1446298cc52ce230be719"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "94b81d39ebece8a77d93e9643bce2c9d"
server_key_iv: "42e59db2292179c09f454e56990da099"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.565076 31369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "31d26f6c13b1446298cc52ce230be719"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "94b81d39ebece8a77d93e9643bce2c9d"
server_key_iv: "42e59db2292179c09f454e56990da099"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.566493 31369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:07:43.567169 31385 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.567337 31369 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:43.567440 31369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "31d26f6c13b1446298cc52ce230be719"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "94b81d39ebece8a77d93e9643bce2c9d"
server_key_iv: "42e59db2292179c09f454e56990da099"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.567520 31369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:43.577314 31369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:43.579236 31369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:43.579397 31369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:43.579862 31369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:43.579924 31369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.579970 31369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:43.579998 31369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.587599 31369 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:40859
I20260806 15:07:43.587682 31505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:40859 every 8 connection(s)
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:43.587993 31369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:43.591184 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.580373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:59187 (local address 127.29.69.190:39015)
0806 15:07:43.580467 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.580470 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.580670 (+ 200us) server_negotiation.cc:407] Connection header received
0806 15:07:43.581319 (+ 649us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.581321 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.581335 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.581404 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.582231 (+ 827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.583107 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.584746 (+ 1639us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.584999 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.585080 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.588568 (+ 3488us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.588569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.588570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.588578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.589744 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.590163 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.590164 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.590164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.590232 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.590522 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.590523 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.590523 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.590642 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.590720 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.590999 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.591085 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260806 15:07:43.591333 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.580310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.29.69.130:59187)
0806 15:07:43.580509 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.580553 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.581188 (+ 635us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.581481 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.581485 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.581848 (+ 363us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:43.582127 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.582133 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.583232 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.583233 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.584650 (+ 1417us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.584653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.585112 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.585114 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.585291 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.586584 (+ 1293us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:43.586594 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:43.588459 (+ 1865us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:43.589831 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.589846 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.589848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.590066 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.590326 (+ 260us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.590327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.590327 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.590443 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.590710 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:43.590717 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:43.590859 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.590961 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.591115 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":79,"threads_started":1}
I20260806 15:07:43.591776 31506 heartbeater.cc:347] Connected to a master server at 127.29.69.190:39015
I20260806 15:07:43.591861 31506 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:43.592032 31506 heartbeater.cc:511] Master 127.29.69.190:39015 requested a full tablet report, sending...
I20260806 15:07:43.592409 31149 ts_manager.cc:194] Registered new tserver with Master: 31d26f6c13b1446298cc52ce230be719 (127.29.69.130:40859)
I20260806 15:07:43.593003 31149 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:59187
I20260806 15:07:43.593370 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 31369
I20260806 15:07:43.593466 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:43.593676 29974 external_mini_cluster.cc:1428] Setting key be923713c1c6c28d57b9c34e11e406b7
I20260806 15:07:43.599120 31513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.592773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.29.69.130:34881)
0806 15:07:43.592971 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.592984 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.593055 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.593212 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.593212 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.593438 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:43.593564 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.593567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.594431 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.594432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.595278 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.595281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.595599 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.595600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.595684 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.596130 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:43.596134 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:43.596388 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:43.597950 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.597951 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.597952 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.598189 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.598443 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.598444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.598445 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.598520 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.598783 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:43.598784 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:43.598838 (+ 54us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.598912 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.599025 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"mutex_wait_us":3,"thread_start_us":82,"threads_started":1}
I20260806 15:07:43.599162 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.592867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:34881 (local address 127.29.69.190:39015)
0806 15:07:43.592907 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.592909 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.593052 (+ 143us) server_negotiation.cc:407] Connection header received
0806 15:07:43.593130 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.593131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.593141 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.593194 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.593649 (+ 455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.594354 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.595354 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.595529 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.595576 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.596478 (+ 902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.596480 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.596480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.596488 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.597864 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.598267 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.598268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.598268 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.598368 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.598596 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.598596 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.598596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.598721 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.598769 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.598945 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.599024 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:43.619295 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39015
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:39149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:43.699963 31516 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:43.700148 31516 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:43.700171 31516 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:43.701314 31516 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:43.701355 31516 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:43.701375 31516 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:07:43.701431 31516 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:43.702852 31516 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:39015
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:43.703088 31516 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:43.703331 31516 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:43.708261 31521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.708381 31516 server_base.cc:1034] running on GCE node
W20260806 15:07:43.708316 31522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:43.708443 31524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:43.708721 31516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:43.708961 31516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:43.710106 31516 hybrid_clock.cc:648] HybridClock initialized: now 1786028863710097 us; error 28 us; skew 500 ppm
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:43.712801 31516 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:43.713186 31516 webserver.cc:460] Webserver started at http://127.29.69.131:37649/ using document root <none> and password file <none>
I20260806 15:07:43.713418 31516 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:43.713487 31516 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:43.713644 31516 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:43.714823 31516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "81b2d414023445e49397be90cfcd79c7"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "f9714e593898be6fd00912b93bb3f310"
server_key_iv: "00af743fff19fe6496be5434b8f49cd5"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.715190 31516 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "81b2d414023445e49397be90cfcd79c7"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "f9714e593898be6fd00912b93bb3f310"
server_key_iv: "00af743fff19fe6496be5434b8f49cd5"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.716634 31516 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:07:43.717415 31531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.717603 31516 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:43.717703 31516 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "81b2d414023445e49397be90cfcd79c7"
format_stamp: "Formatted at 2026-08-06 15:07:43 on dist-test-slave-tm1g"
server_key: "f9714e593898be6fd00912b93bb3f310"
server_key_iv: "00af743fff19fe6496be5434b8f49cd5"
server_key_version: "encryptionkey@0"
I20260806 15:07:43.717787 31516 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:43.734387 31516 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:43.736375 31516 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:43.736528 31516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:43.737039 31516 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:43.737075 31516 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.737106 31516 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:43.737154 31516 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:43.748530 31516 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:45819
I20260806 15:07:43.748600 31651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:45819 every 8 connection(s)
I20260806 15:07:43.748961 31516 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:07:43.749696 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.737559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.29.69.131:40347)
0806 15:07:43.737733 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.737768 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.738268 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.738556 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.738560 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.738800 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:43.738981 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.738985 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.739811 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.739812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.741630 (+ 1818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.741648 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.742329 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.742331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.742527 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.743149 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:43.743161 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:43.745025 (+ 1864us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:43.747973 (+ 2948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.747977 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.747979 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.748329 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.748574 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.748575 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.748576 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.748714 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.749039 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:43.749046 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:43.749232 (+ 186us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.749343 (+ 111us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.749517 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260806 15:07:43.750010 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.737569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:40347 (local address 127.29.69.190:39015)
0806 15:07:43.737625 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.737627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.737867 (+ 240us) server_negotiation.cc:407] Connection header received
0806 15:07:43.738422 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.738424 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.738439 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.738489 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.739091 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.739669 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.741821 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.742188 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.742267 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.745135 (+ 2868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.745137 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.745137 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.745146 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.747881 (+ 2735us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.748419 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.748420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.748420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.748490 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.748782 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.748784 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.748784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.748937 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.749020 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.749867 (+ 847us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.749950 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 15:07:43.750432 31652 heartbeater.cc:347] Connected to a master server at 127.29.69.190:39015
I20260806 15:07:43.750535 31652 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:43.750705 31652 heartbeater.cc:511] Master 127.29.69.190:39015 requested a full tablet report, sending...
I20260806 15:07:43.751129 31147 ts_manager.cc:194] Registered new tserver with Master: 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819)
I20260806 15:07:43.751658 31147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:40347
I20260806 15:07:43.753997 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 31516
I20260806 15:07:43.754078 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:43.754220 29974 external_mini_cluster.cc:1428] Setting key d35b647312b29445fa2338931199d93a
I20260806 15:07:43.755147 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:07:43.757898 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.751528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:55727 (local address 127.29.69.190:39015)
0806 15:07:43.751799 (+ 271us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.751801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.751809 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:07:43.751829 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.751829 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.751848 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.751898 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.752273 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.752734 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.753578 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.753938 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.754013 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.755039 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.755041 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.755041 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.755049 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.756795 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.757178 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.757179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.757179 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.757247 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.757475 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.757475 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.757475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.757569 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.757625 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.757788 (+ 163us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.757842 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":253}
I20260806 15:07:43.758152 31660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.751458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.29.69.131:55727)
0806 15:07:43.751590 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.751600 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.751654 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.751906 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.751907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.752120 (+ 213us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:43.752193 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.752195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.752824 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.752825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.753507 (+ 682us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.753510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.754015 (+ 505us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.754017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.754137 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.754561 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:43.754566 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:43.754952 (+ 386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:43.756886 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.756887 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.756887 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.757088 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.757325 (+ 237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:43.757326 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:43.757327 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:43.757402 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:43.757639 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:43.757640 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:43.757692 (+ 52us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.757774 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.757885 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":67,"threads_started":1}
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 15:07:43 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:43.778259 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.771697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52758 (local address 127.29.69.190:39015)
0806 15:07:43.771752 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.771754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.771764 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:07:43.771836 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.771837 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.771852 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.771916 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:43.772474 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.772964 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.773722 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.773915 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.773990 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.776150 (+ 2160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:43.776151 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:43.776152 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:43.776158 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:43.777317 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.777627 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.777628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.777628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.777676 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:43.777874 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:43.777874 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:43.777874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:43.777968 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:43.778041 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.778141 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.778197 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 15:07:43.779834 31147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:43.781350 31147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:43.787906 31672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.783808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44331 (local address 127.0.0.1:41096)
0806 15:07:43.784108 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.784119 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.784189 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.784477 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.784480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.784482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:43.784548 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.784551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.785561 (+ 1010us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.785562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.786650 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.786653 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.787577 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.787585 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.787667 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.787680 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.787768 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.787823 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":95,"threads_started":1}
I20260806 15:07:43.787918 31675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.784089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41096 (local address 127.29.69.129:44331)
0806 15:07:43.784281 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.784287 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.784298 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:07:43.784349 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.784366 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.784383 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.784459 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:43.784635 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.785471 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.786738 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.787492 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.787576 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.787638 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.787783 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.787823 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":92,"threads_started":1}
I20260806 15:07:43.788415 31671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.783797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40859 (local address 127.0.0.1:38574)
0806 15:07:43.783990 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.784032 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.784104 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.784784 (+ 680us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.784786 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.784788 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:43.784834 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.784836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.786115 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.786116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.787245 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.787248 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.788140 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.788142 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.788202 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.788207 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.788268 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.788309 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":46,"threads_started":1}
I20260806 15:07:43.788463 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.783902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38574 (local address 127.29.69.130:40859)
0806 15:07:43.784535 (+ 633us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.784540 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.784552 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:07:43.784604 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.784607 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.784624 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.784707 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:43.784918 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.786028 (+ 1110us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.787334 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.788060 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.788129 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.788183 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.788292 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.788339 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":593,"thread_start_us":98,"threads_started":1}
I20260806 15:07:43.788565 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.784291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49126 (local address 127.29.69.131:45819)
0806 15:07:43.784613 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.784618 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.784627 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:43.784662 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.784664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.784679 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.784744 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:43.784865 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.785989 (+ 1124us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.787175 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.787906 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.787980 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.788032 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.788406 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.788453 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":289,"thread_start_us":112,"threads_started":1}
I20260806 15:07:43.788724 31673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.783807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:45819 (local address 127.0.0.1:49126)
0806 15:07:43.784223 (+ 416us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.784232 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.784271 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.784758 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.784758 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.784761 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:43.784805 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.784806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.786081 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.786082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.787084 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.787086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.788072 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.788073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.788140 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.788144 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.788192 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.788239 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"mutex_wait_us":47,"thread_start_us":99,"threads_started":1}
I20260806 15:07:43.788977 31291 tablet_service.cc:1467] Processing CreateTablet for tablet 12d857889304481f9d33450891fa9525 (DEFAULT_TABLE table=test-table [id=21ba60ef32d84317a8ef038a5ff4abea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:43.789381 31291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d857889304481f9d33450891fa9525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.789415 31437 tablet_service.cc:1467] Processing CreateTablet for tablet 12d857889304481f9d33450891fa9525 (DEFAULT_TABLE table=test-table [id=21ba60ef32d84317a8ef038a5ff4abea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:43.789474 31566 tablet_service.cc:1467] Processing CreateTablet for tablet 12d857889304481f9d33450891fa9525 (DEFAULT_TABLE table=test-table [id=21ba60ef32d84317a8ef038a5ff4abea]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:43.789739 31437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d857889304481f9d33450891fa9525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.789826 31566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12d857889304481f9d33450891fa9525. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.792636 31677 tablet_bootstrap.cc:492] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Bootstrap starting.
I20260806 15:07:43.793380 31679 tablet_bootstrap.cc:492] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Bootstrap starting.
I20260806 15:07:43.793614 31678 tablet_bootstrap.cc:492] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Bootstrap starting.
I20260806 15:07:43.793851 31677 tablet_bootstrap.cc:654] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.794219 31677 log.cc:824] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:43.794340 31678 tablet_bootstrap.cc:654] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.794692 31678 log.cc:824] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:43.794978 31679 tablet_bootstrap.cc:654] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.795121 31677 tablet_bootstrap.cc:492] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: No bootstrap required, opened a new log
I20260806 15:07:43.795217 31677 ts_tablet_manager.cc:1397] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:07:43.795359 31679 log.cc:824] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:43.795686 31678 tablet_bootstrap.cc:492] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: No bootstrap required, opened a new log
I20260806 15:07:43.795768 31678 ts_tablet_manager.cc:1397] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:43.796087 31679 tablet_bootstrap.cc:492] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: No bootstrap required, opened a new log
I20260806 15:07:43.796159 31679 ts_tablet_manager.cc:1397] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 15:07:43.797219 31677 raft_consensus.cc:348] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.797374 31677 raft_consensus.cc:374] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.797437 31677 raft_consensus.cc:729] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b2d414023445e49397be90cfcd79c7, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.797602 31677 consensus_queue.cc:260] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.797907 31677 ts_tablet_manager.cc:1428] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:43.797839 31678 raft_consensus.cc:348] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.798020 31678 raft_consensus.cc:374] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.797923 31652 heartbeater.cc:503] Master 127.29.69.190:39015 was elected leader, sending a full tablet report...
I20260806 15:07:43.798069 31678 raft_consensus.cc:729] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104ecb9a63ed402c804e87d67a39c1bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.798229 31678 consensus_queue.cc:260] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.798213 31679 raft_consensus.cc:348] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.798458 31679 raft_consensus.cc:374] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.798574 31678 ts_tablet_manager.cc:1428] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:43.798573 31679 raft_consensus.cc:729] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d26f6c13b1446298cc52ce230be719, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.798625 31358 heartbeater.cc:503] Master 127.29.69.190:39015 was elected leader, sending a full tablet report...
I20260806 15:07:43.798727 31679 consensus_queue.cc:260] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.799031 31506 heartbeater.cc:503] Master 127.29.69.190:39015 was elected leader, sending a full tablet report...
I20260806 15:07:43.799011 31679 ts_tablet_manager.cc:1428] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260806 15:07:43.838749 31507 tablet.cc:2369] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:43.851008 31683 raft_consensus.cc:482] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:43.851161 31683 raft_consensus.cc:504] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.851572 31683 leader_election.cc:288] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331), 31d26f6c13b1446298cc52ce230be719 (127.29.69.130:40859)
I20260806 15:07:43.854559 31675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.851858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:40941 (local address 127.29.69.129:44331)
0806 15:07:43.851902 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.851903 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.851912 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:43.851943 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.851944 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.851955 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.852020 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:43.852209 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.852769 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.853766 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.854149 (+ 383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.854237 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.854247 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.854437 (+ 190us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.854482 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:07:43.854568 31540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.851740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44331 (local address 127.29.69.131:40941)
0806 15:07:43.851808 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.851821 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.851870 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.852041 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.852042 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.852044 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:43.852128 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.852130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.852878 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.852879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.853667 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.853669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.854234 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.854235 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.854350 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.854353 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.854416 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.854464 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 15:07:43.854590 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.851817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:37933 (local address 127.29.69.130:40859)
0806 15:07:43.851863 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.851866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.852030 (+ 164us) server_negotiation.cc:407] Connection header received
0806 15:07:43.852074 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.852074 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.852085 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.852137 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:43.852339 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.852794 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.853809 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.854187 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.854274 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.854283 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.854465 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.854511 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:07:43.854643 31686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.851752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40859 (local address 127.29.69.131:37933)
0806 15:07:43.851944 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:43.851955 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:43.852013 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:43.852155 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:43.852156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:43.852157 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:43.852265 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.852266 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.852900 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.852901 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.853710 (+ 809us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:43.853712 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.854275 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.854276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:43.854385 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.854388 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:43.854459 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 15:07:43.854499 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":127,"threads_started":1}
I20260806 15:07:43.854946 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d857889304481f9d33450891fa9525" candidate_uuid: "81b2d414023445e49397be90cfcd79c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ecb9a63ed402c804e87d67a39c1bb" is_pre_election: true
I20260806 15:07:43.855122 31311 raft_consensus.cc:2454] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b2d414023445e49397be90cfcd79c7 in term 0.
I20260806 15:07:43.855369 31457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d857889304481f9d33450891fa9525" candidate_uuid: "81b2d414023445e49397be90cfcd79c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d26f6c13b1446298cc52ce230be719" is_pre_election: true
I20260806 15:07:43.855437 31535 leader_election.cc:302] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ecb9a63ed402c804e87d67a39c1bb, 81b2d414023445e49397be90cfcd79c7; no voters:
I20260806 15:07:43.855480 31457 raft_consensus.cc:2454] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81b2d414023445e49397be90cfcd79c7 in term 0.
I20260806 15:07:43.855581 31683 raft_consensus.cc:2781] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:43.855652 31683 raft_consensus.cc:482] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:43.855687 31683 raft_consensus.cc:3037] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:43.856413 31683 raft_consensus.cc:504] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.856557 31683 leader_election.cc:288] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [CANDIDATE]: Term 1 election: Requested vote from peers 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331), 31d26f6c13b1446298cc52ce230be719 (127.29.69.130:40859)
I20260806 15:07:43.856727 31457 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d857889304481f9d33450891fa9525" candidate_uuid: "81b2d414023445e49397be90cfcd79c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31d26f6c13b1446298cc52ce230be719"
I20260806 15:07:43.856724 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12d857889304481f9d33450891fa9525" candidate_uuid: "81b2d414023445e49397be90cfcd79c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ecb9a63ed402c804e87d67a39c1bb"
I20260806 15:07:43.856804 31311 raft_consensus.cc:3037] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:43.856804 31457 raft_consensus.cc:3037] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:43.857685 31457 raft_consensus.cc:2454] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b2d414023445e49397be90cfcd79c7 in term 1.
I20260806 15:07:43.857685 31311 raft_consensus.cc:2454] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81b2d414023445e49397be90cfcd79c7 in term 1.
I20260806 15:07:43.858397 31534 leader_election.cc:302] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31d26f6c13b1446298cc52ce230be719, 81b2d414023445e49397be90cfcd79c7; no voters:
I20260806 15:07:43.858532 31683 raft_consensus.cc:2781] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:43.858711 31683 raft_consensus.cc:686] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 1 LEADER]: Becoming Leader. State: Replica: 81b2d414023445e49397be90cfcd79c7, State: Running, Role: LEADER
I20260806 15:07:43.858804 31683 consensus_queue.cc:237] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.859587 31149 catalog_manager.cc:5495] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 81b2d414023445e49397be90cfcd79c7 (127.29.69.131). New cstate: current_term: 1 leader_uuid: "81b2d414023445e49397be90cfcd79c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } health_report { overall_health: HEALTHY } } }
I20260806 15:07:43.881637 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:43.879139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49130 (local address 127.29.69.131:45819)
0806 15:07:43.879191 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:43.879193 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:43.879202 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:43.879281 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:43.879282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:43.879301 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:43.879359 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:43.879525 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.879995 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.880779 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:43.880982 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:43.881057 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:43.881272 (+ 215us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:43.881373 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:43.881463 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:43.881507 (+ 44us) server_negotiation.cc:299] Negotiation successful
0806 15:07:43.881528 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 15:07:43.883490 31457 raft_consensus.cc:1261] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Refusing update from remote peer 81b2d414023445e49397be90cfcd79c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:43.883780 31311 raft_consensus.cc:1261] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Refusing update from remote peer 81b2d414023445e49397be90cfcd79c7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:43.883895 31687 consensus_queue.cc:1035] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:43.884074 31687 consensus_queue.cc:1035] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:43.886996 31693 mvcc.cc:205] Tried to move back new op lower bound from 7315574226463825920 to 7315574226366439424. Current Snapshot: MvccSnapshot[applied={T|T < 7315574226463825920}]
I20260806 15:07:43.889827 31147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:43.889950 31147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:43.890856 31147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: Sending DeleteTablet for 3 replicas of tablet 12d857889304481f9d33450891fa9525
I20260806 15:07:43.891211 31291 tablet_service.cc:1514] Processing DeleteTablet for tablet 12d857889304481f9d33450891fa9525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:43 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:41096
I20260806 15:07:43.891256 31437 tablet_service.cc:1514] Processing DeleteTablet for tablet 12d857889304481f9d33450891fa9525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:43 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:38574
I20260806 15:07:43.891481 31702 tablet_replica.cc:330] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: stopping tablet replica
I20260806 15:07:43.891535 31566 tablet_service.cc:1514] Processing DeleteTablet for tablet 12d857889304481f9d33450891fa9525 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:43 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:49126
I20260806 15:07:43.891587 31702 raft_consensus.cc:2229] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:43.891690 31702 raft_consensus.cc:2258] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:43.891685 31147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52758:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:43.891814 31147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:43.891844 31703 tablet_replica.cc:330] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: stopping tablet replica
I20260806 15:07:43.891928 31703 raft_consensus.cc:2229] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:43.892262 31703 raft_consensus.cc:2258] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:43.892602 31702 ts_tablet_manager.cc:1905] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:43.893224 31291 tablet_service.cc:1467] Processing CreateTablet for tablet 057c1f5f59a74e128620c6ec82329171 (DEFAULT_TABLE table=test-table [id=80716c86d4e14886b9f8fc9aecd6df92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:43.893246 31566 tablet_service.cc:1467] Processing CreateTablet for tablet 057c1f5f59a74e128620c6ec82329171 (DEFAULT_TABLE table=test-table [id=80716c86d4e14886b9f8fc9aecd6df92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:43.893365 31291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 057c1f5f59a74e128620c6ec82329171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.893371 31566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 057c1f5f59a74e128620c6ec82329171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.893350 31437 tablet_service.cc:1467] Processing CreateTablet for tablet 057c1f5f59a74e128620c6ec82329171 (DEFAULT_TABLE table=test-table [id=80716c86d4e14886b9f8fc9aecd6df92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:43.893465 31437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 057c1f5f59a74e128620c6ec82329171. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:43.894764 31677 tablet_bootstrap.cc:492] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Bootstrap starting.
I20260806 15:07:43.894917 31678 tablet_bootstrap.cc:492] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Bootstrap starting.
I20260806 15:07:43.895203 31677 tablet_bootstrap.cc:654] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.895495 31678 tablet_bootstrap.cc:654] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.895821 31679 tablet_bootstrap.cc:492] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Bootstrap starting.
I20260806 15:07:43.896235 31679 tablet_bootstrap.cc:654] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:43.896958 31702 ts_tablet_manager.cc:1918] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:43.897047 31702 log.cc:1196] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/12d857889304481f9d33450891fa9525
I20260806 15:07:43.897241 31679 tablet_bootstrap.cc:492] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: No bootstrap required, opened a new log
I20260806 15:07:43.897318 31679 ts_tablet_manager.cc:1397] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:43.897368 31702 ts_tablet_manager.cc:1939] T 12d857889304481f9d33450891fa9525 P 104ecb9a63ed402c804e87d67a39c1bb: Deleting consensus metadata
I20260806 15:07:43.897496 31679 raft_consensus.cc:348] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.897559 31679 raft_consensus.cc:374] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.897579 31679 raft_consensus.cc:729] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d26f6c13b1446298cc52ce230be719, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.897626 31679 consensus_queue.cc:260] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.897725 31679 ts_tablet_manager.cc:1428] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:43.897758 31135 catalog_manager.cc:4841] TS 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331): tablet 12d857889304481f9d33450891fa9525 (table test-table [id=21ba60ef32d84317a8ef038a5ff4abea]) successfully deleted
I20260806 15:07:43.897967 31704 tablet_replica.cc:330] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: stopping tablet replica
I20260806 15:07:43.898053 31678 tablet_bootstrap.cc:492] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: No bootstrap required, opened a new log
I20260806 15:07:43.898103 31678 ts_tablet_manager.cc:1397] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260806 15:07:43.898109 31704 raft_consensus.cc:2229] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:43.898237 31704 raft_consensus.cc:2258] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:43.898244 31678 raft_consensus.cc:348] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.898326 31678 raft_consensus.cc:374] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.898360 31678 raft_consensus.cc:729] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104ecb9a63ed402c804e87d67a39c1bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.898433 31678 consensus_queue.cc:260] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.898523 31678 ts_tablet_manager.cc:1428] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:43.898746 31704 ts_tablet_manager.cc:1905] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:43.899214 31703 ts_tablet_manager.cc:1905] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:43.900389 31704 ts_tablet_manager.cc:1918] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:43.900511 31704 log.cc:1196] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/12d857889304481f9d33450891fa9525
I20260806 15:07:43.900825 31704 ts_tablet_manager.cc:1939] T 12d857889304481f9d33450891fa9525 P 81b2d414023445e49397be90cfcd79c7: Deleting consensus metadata
I20260806 15:07:43.900920 31703 ts_tablet_manager.cc:1918] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:43.900996 31703 log.cc:1196] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/12d857889304481f9d33450891fa9525
I20260806 15:07:43.901291 31133 catalog_manager.cc:4841] TS 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819): tablet 12d857889304481f9d33450891fa9525 (table test-table [id=21ba60ef32d84317a8ef038a5ff4abea]) successfully deleted
I20260806 15:07:43.901319 31703 ts_tablet_manager.cc:1939] T 12d857889304481f9d33450891fa9525 P 31d26f6c13b1446298cc52ce230be719: Deleting consensus metadata
I20260806 15:07:43.901731 31134 catalog_manager.cc:4841] TS 31d26f6c13b1446298cc52ce230be719 (127.29.69.130:40859): tablet 12d857889304481f9d33450891fa9525 (table test-table [id=21ba60ef32d84317a8ef038a5ff4abea]) successfully deleted
I20260806 15:07:43.901983 31677 tablet_bootstrap.cc:492] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: No bootstrap required, opened a new log
I20260806 15:07:43.902037 31677 ts_tablet_manager.cc:1397] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260806 15:07:43.902194 31677 raft_consensus.cc:348] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.902261 31677 raft_consensus.cc:374] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:43.902280 31677 raft_consensus.cc:729] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b2d414023445e49397be90cfcd79c7, State: Initialized, Role: FOLLOWER
I20260806 15:07:43.902350 31677 consensus_queue.cc:260] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:43.902431 31677 ts_tablet_manager.cc:1428] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260806 15:07:43.941123 31360 tablet.cc:2369] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:07:43.999691 31653 tablet.cc:2369] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:44.031302 31685 raft_consensus.cc:482] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:44.031406 31685 raft_consensus.cc:504] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.031704 31685 leader_election.cc:288] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331), 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819)
I20260806 15:07:44.035696 31676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.032006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:37557 (local address 127.29.69.131:45819)
0806 15:07:44.032057 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.032060 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.032068 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:07:44.032107 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.032107 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.032117 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.032204 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:44.032448 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.033208 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.034753 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.035322 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.035400 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.035409 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.035581 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.035620 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:07:44.035696 31675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.031997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:38895 (local address 127.29.69.129:44331)
0806 15:07:44.032051 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.032053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.032201 (+ 148us) server_negotiation.cc:407] Connection header received
0806 15:07:44.032235 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.032236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.032245 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.032298 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:44.032465 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.033208 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.034753 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.035322 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.035400 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.035409 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.035581 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.035624 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:07:44.035725 31394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.031918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:45819 (local address 127.29.69.130:37557)
0806 15:07:44.031983 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:44.031995 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:44.032041 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:44.032236 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:44.032237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:44.032239 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:44.032346 (+ 107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.032349 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.033307 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.033308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.034654 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.034658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.035414 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.035415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.035505 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.035507 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:07:44.035560 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 15:07:44.035616 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":65}
I20260806 15:07:44.035739 31708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.031919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44331 (local address 127.29.69.130:38895)
0806 15:07:44.032088 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:44.032097 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:44.032152 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:44.032316 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:44.032316 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:44.032318 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:44.032386 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.032388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.033307 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.033308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.034654 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.034658 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.035432 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.035433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.035497 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.035501 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:44.035560 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 15:07:44.035616 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":81,"thread_start_us":76,"threads_started":1}
I20260806 15:07:44.036020 31595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057c1f5f59a74e128620c6ec82329171" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b2d414023445e49397be90cfcd79c7" is_pre_election: true
I20260806 15:07:44.036096 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057c1f5f59a74e128620c6ec82329171" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ecb9a63ed402c804e87d67a39c1bb" is_pre_election: true
I20260806 15:07:44.036173 31311 raft_consensus.cc:2454] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 0.
I20260806 15:07:44.036175 31595 raft_consensus.cc:2454] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 0.
I20260806 15:07:44.036347 31389 leader_election.cc:302] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ecb9a63ed402c804e87d67a39c1bb, 31d26f6c13b1446298cc52ce230be719; no voters:
I20260806 15:07:44.036506 31685 raft_consensus.cc:2781] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:44.036556 31685 raft_consensus.cc:482] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:44.036589 31685 raft_consensus.cc:3037] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:44.037295 31685 raft_consensus.cc:504] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.037452 31685 leader_election.cc:288] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 election: Requested vote from peers 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331), 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819)
I20260806 15:07:44.037627 31595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057c1f5f59a74e128620c6ec82329171" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b2d414023445e49397be90cfcd79c7"
I20260806 15:07:44.037636 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "057c1f5f59a74e128620c6ec82329171" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ecb9a63ed402c804e87d67a39c1bb"
I20260806 15:07:44.037709 31595 raft_consensus.cc:3037] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:44.037710 31311 raft_consensus.cc:3037] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:44.038470 31311 raft_consensus.cc:2454] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 1.
I20260806 15:07:44.038592 31595 raft_consensus.cc:2454] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 1.
I20260806 15:07:44.038650 31389 leader_election.cc:302] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ecb9a63ed402c804e87d67a39c1bb, 31d26f6c13b1446298cc52ce230be719; no voters:
I20260806 15:07:44.038744 31685 raft_consensus.cc:2781] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:44.038906 31685 raft_consensus.cc:686] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 1 LEADER]: Becoming Leader. State: Replica: 31d26f6c13b1446298cc52ce230be719, State: Running, Role: LEADER
I20260806 15:07:44.038965 31685 consensus_queue.cc:237] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.039762 31149 catalog_manager.cc:5495] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31d26f6c13b1446298cc52ce230be719 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } health_report { overall_health: UNKNOWN } } }
Aug 06 15:07:44 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:44.065327 31717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.058936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39015 (local address 127.0.0.1:52768)
0806 15:07:44.059108 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:44.059118 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:44.059175 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:44.059288 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:44.059289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:44.059573 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:44.059617 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.059619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.060219 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.060220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.060750 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.060751 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.061090 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.061092 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.061146 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.061702 (+ 556us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:44.061706 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:44.063087 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:44.064423 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:44.064430 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:44.064432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:44.064623 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:44.064788 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:44.064788 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:44.064788 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:44.064842 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:44.065040 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:44.065046 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:44.065084 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 15:07:44.065134 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 15:07:44.065219 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":116,"threads_started":1}
I20260806 15:07:44.065356 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.058970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.29.69.190:39015)
0806 15:07:44.059036 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.059038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.059177 (+ 139us) server_negotiation.cc:407] Connection header received
0806 15:07:44.059226 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.059227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.059236 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.059275 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:44.059677 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.060147 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.060820 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.061006 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.061060 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.063160 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:44.063161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:44.063162 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:44.063167 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:44.064353 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:44.064686 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:44.064687 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:44.064687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:44.064734 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:44.064892 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:44.064893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:44.064893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:44.064984 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:44.065039 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.065165 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.065265 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":38,"server-negotiator.queue_time_us":40}
I20260806 15:07:44.067651 31149 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:52768:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 15:07:44.067857 31149 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:44.069199 31291 tablet_service.cc:1467] Processing CreateTablet for tablet afb638340b2a4c41ae580b6db8629ccf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9da248d511ee492594f8c95b259bf420]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:07:44.069223 31566 tablet_service.cc:1467] Processing CreateTablet for tablet afb638340b2a4c41ae580b6db8629ccf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9da248d511ee492594f8c95b259bf420]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:07:44.069382 31291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afb638340b2a4c41ae580b6db8629ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:44.069384 31566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afb638340b2a4c41ae580b6db8629ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:44.070688 31437 tablet_service.cc:1467] Processing CreateTablet for tablet afb638340b2a4c41ae580b6db8629ccf (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=9da248d511ee492594f8c95b259bf420]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:07:44.070850 31437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet afb638340b2a4c41ae580b6db8629ccf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:44.072029 31677 tablet_bootstrap.cc:492] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: Bootstrap starting.
I20260806 15:07:44.072041 31679 tablet_bootstrap.cc:492] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: Bootstrap starting.
I20260806 15:07:44.072405 31677 tablet_bootstrap.cc:654] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:44.072436 31679 tablet_bootstrap.cc:654] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:44.073045 31677 tablet_bootstrap.cc:492] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: No bootstrap required, opened a new log
I20260806 15:07:44.073107 31677 ts_tablet_manager.cc:1397] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:44.073168 31679 tablet_bootstrap.cc:492] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: No bootstrap required, opened a new log
I20260806 15:07:44.073205 31679 ts_tablet_manager.cc:1397] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:44.073239 31677 raft_consensus.cc:348] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.073309 31677 raft_consensus.cc:374] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:44.073328 31677 raft_consensus.cc:729] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b2d414023445e49397be90cfcd79c7, State: Initialized, Role: FOLLOWER
I20260806 15:07:44.073341 31679 raft_consensus.cc:348] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.073403 31679 raft_consensus.cc:374] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:44.073380 31677 consensus_queue.cc:260] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.073424 31679 raft_consensus.cc:729] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31d26f6c13b1446298cc52ce230be719, State: Initialized, Role: FOLLOWER
I20260806 15:07:44.073483 31677 ts_tablet_manager.cc:1428] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:44.073465 31679 consensus_queue.cc:260] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.073565 31679 ts_tablet_manager.cc:1428] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:44.073526 31698 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.073599 31698 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.073706 31685 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.073763 31685 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.074208 31678 tablet_bootstrap.cc:492] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: Bootstrap starting.
I20260806 15:07:44.074648 31678 tablet_bootstrap.cc:654] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:44.075240 31678 tablet_bootstrap.cc:492] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: No bootstrap required, opened a new log
I20260806 15:07:44.075284 31678 ts_tablet_manager.cc:1397] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:44.075428 31678 raft_consensus.cc:348] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.075491 31678 raft_consensus.cc:374] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:44.075506 31678 raft_consensus.cc:729] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 104ecb9a63ed402c804e87d67a39c1bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:44.075574 31678 consensus_queue.cc:260] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.075677 31678 ts_tablet_manager.cc:1428] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:44.075716 31684 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.075812 31684 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.095633 31685 raft_consensus.cc:482] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:44.095742 31685 raft_consensus.cc:504] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.095896 31685 leader_election.cc:288] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331), 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819)
I20260806 15:07:44.096107 31595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb638340b2a4c41ae580b6db8629ccf" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b2d414023445e49397be90cfcd79c7" is_pre_election: true
I20260806 15:07:44.096148 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb638340b2a4c41ae580b6db8629ccf" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ecb9a63ed402c804e87d67a39c1bb" is_pre_election: true
I20260806 15:07:44.096215 31595 raft_consensus.cc:2454] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 0.
I20260806 15:07:44.096228 31311 raft_consensus.cc:2454] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 0.
I20260806 15:07:44.096376 31389 leader_election.cc:302] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ecb9a63ed402c804e87d67a39c1bb, 31d26f6c13b1446298cc52ce230be719; no voters:
I20260806 15:07:44.096500 31685 raft_consensus.cc:2781] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:44.096566 31685 raft_consensus.cc:482] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:44.096596 31685 raft_consensus.cc:3037] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:44.097291 31685 raft_consensus.cc:504] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.097440 31685 leader_election.cc:288] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 election: Requested vote from peers 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331), 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819)
I20260806 15:07:44.097620 31595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb638340b2a4c41ae580b6db8629ccf" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81b2d414023445e49397be90cfcd79c7"
I20260806 15:07:44.097697 31595 raft_consensus.cc:3037] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:44.097637 31311 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "afb638340b2a4c41ae580b6db8629ccf" candidate_uuid: "31d26f6c13b1446298cc52ce230be719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "104ecb9a63ed402c804e87d67a39c1bb"
I20260806 15:07:44.097729 31311 raft_consensus.cc:3037] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:44.098357 31311 raft_consensus.cc:2454] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 1.
I20260806 15:07:44.098359 31595 raft_consensus.cc:2454] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31d26f6c13b1446298cc52ce230be719 in term 1.
I20260806 15:07:44.098531 31389 leader_election.cc:302] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 104ecb9a63ed402c804e87d67a39c1bb, 31d26f6c13b1446298cc52ce230be719; no voters:
I20260806 15:07:44.098614 31685 raft_consensus.cc:2781] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:44.098680 31685 raft_consensus.cc:686] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [term 1 LEADER]: Becoming Leader. State: Replica: 31d26f6c13b1446298cc52ce230be719, State: Running, Role: LEADER
I20260806 15:07:44.098732 31685 consensus_queue.cc:237] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } }
I20260806 15:07:44.099078 31709 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: TxnStatusTablet state changed. Reason: New leader 31d26f6c13b1446298cc52ce230be719. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.099165 31709 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:07:44.099355 31149 catalog_manager.cc:5495] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31d26f6c13b1446298cc52ce230be719 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:44.099814 31722 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 15:07:44.099969 31722 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 15:07:44.112605 31717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.109591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40859 (local address 127.0.0.1:38576)
0806 15:07:44.109690 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:44.109704 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:44.109759 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:44.109936 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:44.109937 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:44.109938 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:07:44.109997 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.109999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.110994 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.110996 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.111559 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.111561 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.112022 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.112023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.112148 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.112166 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:07:44.112464 (+ 298us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:07:44.112472 (+ 8us) client_negotiation.cc:769] Sending connection context
0806 15:07:44.112510 (+ 38us) client_negotiation.cc:240] Negotiation successful
0806 15:07:44.112549 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49}
I20260806 15:07:44.112607 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.109682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38576 (local address 127.29.69.130:40859)
0806 15:07:44.109743 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.109746 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.109756 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:07:44.109842 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.109843 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.109862 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.109926 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:44.110063 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.110893 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.111639 (+ 746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.111945 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.112025 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.112277 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:44.112403 (+ 126us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:44.112471 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.112514 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.112535 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:07:44.113853 31311 raft_consensus.cc:1261] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Refusing update from remote peer 31d26f6c13b1446298cc52ce230be719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:44.113925 31595 raft_consensus.cc:1261] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Refusing update from remote peer 31d26f6c13b1446298cc52ce230be719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:44.114115 31685 consensus_queue.cc:1035] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:44.114219 31709 consensus_queue.cc:1035] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:44.114804 31684 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: TxnStatusTablet state changed. Reason: New leader 31d26f6c13b1446298cc52ce230be719. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.114904 31684 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.114964 31698 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: TxnStatusTablet state changed. Reason: New leader 31d26f6c13b1446298cc52ce230be719. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.115053 31698 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.115504 31685 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.115577 31691 mvcc.cc:205] Tried to move back new op lower bound from 7315574227408216064 to 7315574227348996096. Current Snapshot: MvccSnapshot[applied={T|T < 7315574227408216064 or (T in {7315574227408216064})}]
I20260806 15:07:44.115589 31685 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:07:44.115989 31684 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.116070 31684 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 104ecb9a63ed402c804e87d67a39c1bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.116823 31709 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.116909 31709 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 31d26f6c13b1446298cc52ce230be719: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:07:44.117182 31690 mvcc.cc:205] Tried to move back new op lower bound from 7315574227408216064 to 7315574227348996096. Current Snapshot: MvccSnapshot[applied={T|T < 7315574227408216064}]
I20260806 15:07:44.117269 31698 tablet_replica.cc:439] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "31d26f6c13b1446298cc52ce230be719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 } } peers { permanent_uuid: "31d26f6c13b1446298cc52ce230be719" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40859 } } peers { permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 } } }
I20260806 15:07:44.117333 31698 tablet_replica.cc:442] T afb638340b2a4c41ae580b6db8629ccf P 81b2d414023445e49397be90cfcd79c7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:44.120121 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.117596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38592 (local address 127.29.69.130:40859)
0806 15:07:44.117634 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.117636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.117643 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:07:44.117662 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.117663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.117672 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.117724 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:44.117874 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.118605 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.119287 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.119582 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.119648 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.119859 (+ 211us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:44.119891 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:44.119941 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.120041 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.120059 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:44.124784 31674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.122541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:33597 (local address 127.29.69.130:40859)
0806 15:07:44.122574 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.122576 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.122717 (+ 141us) server_negotiation.cc:407] Connection header received
0806 15:07:44.122798 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.122799 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.122808 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.122860 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:44.122982 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.123402 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.124123 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.124299 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.124376 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.124547 (+ 171us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:44.124580 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:44.124637 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.124696 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.124710 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260806 15:07:44.124847 31730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.122500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40859 (local address 127.29.69.130:33597)
0806 15:07:44.122648 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:44.122660 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:44.122743 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:44.122863 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:44.122864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:44.122865 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:07:44.122920 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.122921 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.123475 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.123476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.124030 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:44.124031 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.124383 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.124384 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:44.124441 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.124461 (+ 20us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:07:44.124638 (+ 177us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:07:44.124640 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:07:44.124692 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 15:07:44.124728 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":84,"threads_started":1}
I20260806 15:07:44.126866 31311 raft_consensus.cc:1261] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Refusing update from remote peer 31d26f6c13b1446298cc52ce230be719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:44.127060 31595 raft_consensus.cc:1261] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Refusing update from remote peer 31d26f6c13b1446298cc52ce230be719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:44.127151 31709 consensus_queue.cc:1035] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "104ecb9a63ed402c804e87d67a39c1bb" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:44.127234 31685 consensus_queue.cc:1035] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81b2d414023445e49397be90cfcd79c7" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 45819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:44.139117 31147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:44.139194 31147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52758:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:44.139846 31147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a55f565e34094815ac329a24158355ba: Sending DeleteTablet for 3 replicas of tablet 057c1f5f59a74e128620c6ec82329171
I20260806 15:07:44.140087 31291 tablet_service.cc:1514] Processing DeleteTablet for tablet 057c1f5f59a74e128620c6ec82329171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:44 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:41096
I20260806 15:07:44.140188 31702 tablet_replica.cc:330] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: stopping tablet replica
I20260806 15:07:44.140159 31566 tablet_service.cc:1514] Processing DeleteTablet for tablet 057c1f5f59a74e128620c6ec82329171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:44 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:49126
I20260806 15:07:44.140180 31437 tablet_service.cc:1514] Processing DeleteTablet for tablet 057c1f5f59a74e128620c6ec82329171 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:44 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:38574
I20260806 15:07:44.140239 31702 raft_consensus.cc:2229] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:44.140252 31704 tablet_replica.cc:330] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: stopping tablet replica
I20260806 15:07:44.140273 31702 raft_consensus.cc:2258] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:44.140295 31704 raft_consensus.cc:2229] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:44.140354 31704 raft_consensus.cc:2258] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:44.140345 31703 tablet_replica.cc:330] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: stopping tablet replica
I20260806 15:07:44.140396 31703 raft_consensus.cc:2229] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:44.140484 31703 raft_consensus.cc:2258] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:44.140638 31704 ts_tablet_manager.cc:1905] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:44.140839 31702 ts_tablet_manager.cc:1905] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:44.142022 31703 ts_tablet_manager.cc:1905] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:44.142083 31702 ts_tablet_manager.cc:1918] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:44.142146 31702 log.cc:1196] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/057c1f5f59a74e128620c6ec82329171
I20260806 15:07:44.142400 31702 ts_tablet_manager.cc:1939] T 057c1f5f59a74e128620c6ec82329171 P 104ecb9a63ed402c804e87d67a39c1bb: Deleting consensus metadata
I20260806 15:07:44.142693 31135 catalog_manager.cc:4841] TS 104ecb9a63ed402c804e87d67a39c1bb (127.29.69.129:44331): tablet 057c1f5f59a74e128620c6ec82329171 (table test-table [id=80716c86d4e14886b9f8fc9aecd6df92]) successfully deleted
I20260806 15:07:44.143615 31703 ts_tablet_manager.cc:1918] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:44.143615 31704 ts_tablet_manager.cc:1918] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:44.143672 31703 log.cc:1196] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/057c1f5f59a74e128620c6ec82329171
I20260806 15:07:44.143689 31704 log.cc:1196] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/057c1f5f59a74e128620c6ec82329171
I20260806 15:07:44.143911 31703 ts_tablet_manager.cc:1939] T 057c1f5f59a74e128620c6ec82329171 P 31d26f6c13b1446298cc52ce230be719: Deleting consensus metadata
I20260806 15:07:44.143939 31704 ts_tablet_manager.cc:1939] T 057c1f5f59a74e128620c6ec82329171 P 81b2d414023445e49397be90cfcd79c7: Deleting consensus metadata
I20260806 15:07:44.144237 31134 catalog_manager.cc:4841] TS 31d26f6c13b1446298cc52ce230be719 (127.29.69.130:40859): tablet 057c1f5f59a74e128620c6ec82329171 (table test-table [id=80716c86d4e14886b9f8fc9aecd6df92]) successfully deleted
I20260806 15:07:44.144238 31133 catalog_manager.cc:4841] TS 81b2d414023445e49397be90cfcd79c7 (127.29.69.131:45819): tablet 057c1f5f59a74e128620c6ec82329171 (table test-table [id=80716c86d4e14886b9f8fc9aecd6df92]) successfully deleted
Aug 06 15:07:44 dist-test-slave-tm1g krb5kdc[31101](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028863, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:44.158711 31675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.150000 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41112 (local address 127.29.69.129:44331)
0806 15:07:44.150042 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.150044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.150167 (+ 123us) server_negotiation.cc:407] Connection header received
0806 15:07:44.150243 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.150243 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.150254 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.150327 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:44.150960 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.151446 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.152157 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.152365 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.152467 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.155425 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:44.155436 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:44.155436 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:44.155444 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:44.157434 (+ 1990us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:44.157777 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:44.157780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:44.157781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:44.157862 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:44.158099 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:44.158100 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:44.158100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:44.158276 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:44.158491 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.158533 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.158612 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 15:07:44.158987 31352 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41112
I20260806 15:07:44.166167 31200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:44.160020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52772 (local address 127.29.69.190:39015)
0806 15:07:44.160068 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:44.160070 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:44.160082 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:07:44.160160 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:44.160162 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:44.160172 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:44.160229 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:44.160676 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.161453 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.162090 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:44.162429 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:44.162501 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:44.163591 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:44.163593 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:44.163593 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:44.163602 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:44.165130 (+ 1528us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:44.165452 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:44.165453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:44.165454 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:44.165516 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:44.165691 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:44.165692 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:44.165692 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:44.165822 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:44.165919 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:44.165998 (+ 79us) server_negotiation.cc:299] Negotiation successful
0806 15:07:44.166072 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
W20260806 15:07:44.166417 31147 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:52772
I20260806 15:07:44.167196 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 31223
I20260806 15:07:44.176412 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 31369
I20260806 15:07:44.182713 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 31516
I20260806 15:07:44.188732 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 31115
2026-08-06T15:07:44Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2233 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:44 dist-test-slave-tm1g krb5kdc[31742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:44 dist-test-slave-tm1g krb5kdc[31742](info): set up 2 sockets
Aug 06 15:07:44 dist-test-slave-tm1g krb5kdc[31742](info): commencing operation
krb5kdc: starting...
W20260806 15:07:45.249820 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.040s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:45.365113 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33663
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:33663
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:45.444890 31756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:45.445143 31756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:45.445183 31756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:45.446364 31756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:45.446432 31756 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 15:07:45.446455 31756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:45.446477 31756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:45.446509 31756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:45.446535 31756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:45.447995 31756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:33663
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:45.448293 31756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:45.448519 31756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:45.453207 31761 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.453207 31765 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.453253 31763 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:45.453281 31756 server_base.cc:1034] running on GCE node
I20260806 15:07:45.453624 31756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:45.453900 31756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:45.455041 31756 hybrid_clock.cc:648] HybridClock initialized: now 1786028865455021 us; error 37 us; skew 500 ppm
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:45.457388 31756 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:45.457798 31756 webserver.cc:460] Webserver started at http://127.29.69.190:45087/ using document root <none> and password file <none>
I20260806 15:07:45.458017 31756 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:45.458087 31756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:45.458244 31756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:45.459291 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "d11e061d2c324d3e92017a06a40fd4c4"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "462b35197daa98c9ba76ffc3692005a1"
server_key_iv: "0f67acbb96b52be8625acbe49f441a1e"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.459658 31756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "d11e061d2c324d3e92017a06a40fd4c4"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "462b35197daa98c9ba76ffc3692005a1"
server_key_iv: "0f67acbb96b52be8625acbe49f441a1e"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.460944 31756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:45.461621 31772 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:45.461789 31756 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:45.461889 31756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "d11e061d2c324d3e92017a06a40fd4c4"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "462b35197daa98c9ba76ffc3692005a1"
server_key_iv: "0f67acbb96b52be8625acbe49f441a1e"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.461970 31756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:45.485618 31756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:45.487514 31756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:45.487709 31756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:45.492370 31756 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:33663
I20260806 15:07:45.492424 31838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:33663 every 8 connection(s)
I20260806 15:07:45.492743 31756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:45.493342 31839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:45.495597 31839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Bootstrap starting.
I20260806 15:07:45.496188 31839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:45.496481 31839 log.cc:824] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:45.497176 31839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: No bootstrap required, opened a new log
I20260806 15:07:45.499401 31839 raft_consensus.cc:348] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11e061d2c324d3e92017a06a40fd4c4" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33663 } }
I20260806 15:07:45.499570 31839 raft_consensus.cc:374] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:45.499622 31839 raft_consensus.cc:729] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d11e061d2c324d3e92017a06a40fd4c4, State: Initialized, Role: FOLLOWER
I20260806 15:07:45.499791 31839 consensus_queue.cc:260] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11e061d2c324d3e92017a06a40fd4c4" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33663 } }
I20260806 15:07:45.499892 31839 raft_consensus.cc:388] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:45.499936 31839 raft_consensus.cc:482] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:45.499958 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 31756
I20260806 15:07:45.499987 31839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:45.500057 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:45.500221 29974 external_mini_cluster.cc:1428] Setting key 6c011f335780b2e3905cd5e9430a2f8b
I20260806 15:07:45.500604 31839 raft_consensus.cc:504] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11e061d2c324d3e92017a06a40fd4c4" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33663 } }
I20260806 15:07:45.500715 31839 leader_election.cc:302] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d11e061d2c324d3e92017a06a40fd4c4; no voters:
I20260806 15:07:45.500865 31839 leader_election.cc:288] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:45.500890 31845 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:45.501106 31845 raft_consensus.cc:686] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [term 1 LEADER]: Becoming Leader. State: Replica: d11e061d2c324d3e92017a06a40fd4c4, State: Running, Role: LEADER
I20260806 15:07:45.501219 31839 sys_catalog.cc:564] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:45.501252 31845 consensus_queue.cc:237] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11e061d2c324d3e92017a06a40fd4c4" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33663 } }
I20260806 15:07:45.501662 31845 sys_catalog.cc:455] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d11e061d2c324d3e92017a06a40fd4c4. Latest consensus state: current_term: 1 leader_uuid: "d11e061d2c324d3e92017a06a40fd4c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11e061d2c324d3e92017a06a40fd4c4" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33663 } } }
I20260806 15:07:45.501825 31845 sys_catalog.cc:458] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:45.502107 31854 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:45.502365 31846 sys_catalog.cc:455] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d11e061d2c324d3e92017a06a40fd4c4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d11e061d2c324d3e92017a06a40fd4c4" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33663 } } }
I20260806 15:07:45.502488 31846 sys_catalog.cc:458] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:45.502799 31854 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:45.504670 31854 catalog_manager.cc:1347] Generated new cluster ID: 8679d61bc0ef47bcae89122cad050cfe
I20260806 15:07:45.504765 31854 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:45.510749 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.500694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46358 (local address 127.29.69.190:33663)
0806 15:07:45.500891 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:45.500902 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:45.500937 (+ 35us) server_negotiation.cc:407] Connection header received
0806 15:07:45.501114 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:45.501121 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:45.501185 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:45.501322 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:45.502069 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.503550 (+ 1481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.504606 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.504986 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.505111 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.507439 (+ 2328us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:45.507443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:45.507443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:45.507455 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:45.509146 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.509536 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.509539 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.509539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.509639 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.509876 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.509877 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.509877 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.510106 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:45.510288 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:45.510395 (+ 107us) server_negotiation.cc:299] Negotiation successful
0806 15:07:45.510534 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":75,"threads_started":1}
I20260806 15:07:45.543208 31854 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:45.543920 31854 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:45.552103 31854 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Generated new TSK 0
I20260806 15:07:45.552291 31854 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:45.579257 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:33663
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:45.659838 31868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:45.660023 31868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:45.660048 31868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:45.661111 31868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:45.661142 31868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:45.661163 31868 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 15:07:45.661175 31868 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:07:45.661191 31868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:45.662624 31868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:33663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31868
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:45.662797 31868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:45.662962 31868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:45.667869 31875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.667842 31877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.667884 31874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:45.668102 31868 server_base.cc:1034] running on GCE node
I20260806 15:07:45.668277 31868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:45.668454 31868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:45.669631 31868 hybrid_clock.cc:648] HybridClock initialized: now 1786028865669617 us; error 35 us; skew 500 ppm
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:45.672047 31868 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:45.672566 31868 webserver.cc:460] Webserver started at http://127.29.69.129:36755/ using document root <none> and password file <none>
I20260806 15:07:45.672789 31868 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:45.672856 31868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:45.673007 31868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:45.674065 31868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "8695ef2b630547eda89868a4fe050c7c"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "f58010a4858d989f8dad2a8f9239777f"
server_key_iv: "bb894bd710f31474f16d5ee44776d99a"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.674460 31868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "8695ef2b630547eda89868a4fe050c7c"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "f58010a4858d989f8dad2a8f9239777f"
server_key_iv: "bb894bd710f31474f16d5ee44776d99a"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.675756 31868 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:45.676438 31884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:45.676623 31868 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:45.676720 31868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "8695ef2b630547eda89868a4fe050c7c"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "f58010a4858d989f8dad2a8f9239777f"
server_key_iv: "bb894bd710f31474f16d5ee44776d99a"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.676806 31868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:45.690565 31868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:45.692283 31868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:45.692441 31868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:45.692979 31868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:45.693042 31868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:45.693089 31868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:45.693110 31868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:45.700424 31868 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:40319
I20260806 15:07:45.700775 31868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:45.701193 32002 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:40319 every 8 connection(s)
I20260806 15:07:45.702859 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.693354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:56621 (local address 127.29.69.190:33663)
0806 15:07:45.693424 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:45.693427 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:45.693686 (+ 259us) server_negotiation.cc:407] Connection header received
0806 15:07:45.694129 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:45.694131 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:45.694149 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:45.694237 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:45.694977 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.695837 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.696881 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.697103 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.697182 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.699892 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:45.699894 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:45.699894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:45.699902 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:45.701536 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.701884 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.701885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.701885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.701982 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.702260 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.702260 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.702261 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.702424 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:45.702478 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:45.702733 (+ 255us) server_negotiation.cc:299] Negotiation successful
0806 15:07:45.702798 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:07:45.703007 31893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.693354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.29.69.129:56621)
0806 15:07:45.693529 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:45.693577 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:45.694027 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:45.694282 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:45.694286 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:45.694637 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:45.694874 (+ 237us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.694878 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.695974 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.695975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.696780 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.696782 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.697191 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.697193 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.697330 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.697808 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:45.697816 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:45.699789 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:45.701606 (+ 1817us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.701611 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.701612 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.701817 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.702062 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.702062 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.702063 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.702160 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.702484 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:45.702490 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:45.702618 (+ 128us) client_negotiation.cc:769] Sending connection context
0806 15:07:45.702703 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 15:07:45.702818 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260806 15:07:45.703490 32003 heartbeater.cc:347] Connected to a master server at 127.29.69.190:33663
I20260806 15:07:45.703603 32003 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:45.703733 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 31868
I20260806 15:07:45.703800 32003 heartbeater.cc:511] Master 127.29.69.190:33663 requested a full tablet report, sending...
I20260806 15:07:45.703830 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:45.704015 29974 external_mini_cluster.cc:1428] Setting key dfaa3a8eafa7b2b5a78700a5b8135d55
I20260806 15:07:45.704356 31789 ts_manager.cc:194] Registered new tserver with Master: 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319)
I20260806 15:07:45.705200 31789 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:56621
I20260806 15:07:45.710942 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.704691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:45235 (local address 127.29.69.190:33663)
0806 15:07:45.704726 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:45.704727 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:45.704872 (+ 145us) server_negotiation.cc:407] Connection header received
0806 15:07:45.704913 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:45.704914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:45.704922 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:45.704979 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:45.705498 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.705997 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.706782 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.706988 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.707076 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.708333 (+ 1257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:45.708334 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:45.708335 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:45.708340 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:45.709766 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.710182 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.710183 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.710183 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.710231 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.710469 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.710470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.710470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.710565 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:45.710614 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:45.710816 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 15:07:45.710887 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 15:07:45.711014 32011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.704656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.29.69.129:45235)
0806 15:07:45.704799 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:45.704810 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:45.704870 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:45.704983 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:45.704984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:45.705194 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:45.705272 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.705273 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.706099 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.706100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.706697 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.706699 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.707079 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.707080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.707163 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.707751 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:45.707757 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:45.708246 (+ 489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:45.709853 (+ 1607us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.709854 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.709854 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.710107 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.710299 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.710321 (+ 22us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.710321 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.710397 (+ 76us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.710632 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:45.710633 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:45.710695 (+ 62us) client_negotiation.cc:769] Sending connection context
0806 15:07:45.710780 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 15:07:45.710885 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:45.729167 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:33663
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:45.814898 32014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:45.815081 32014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:45.815104 32014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:45.816681 32014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:45.816733 32014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:45.816756 32014 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 15:07:45.816767 32014 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:07:45.816815 32014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:45.818429 32014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:33663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32014
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:45.818648 32014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:45.818872 32014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:45.823704 32025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.823704 32022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.823846 32023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:45.823935 32014 server_base.cc:1034] running on GCE node
I20260806 15:07:45.824173 32014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:45.824393 32014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:45.825570 32014 hybrid_clock.cc:648] HybridClock initialized: now 1786028865825558 us; error 24 us; skew 500 ppm
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:45.828009 32014 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:45.828505 32014 webserver.cc:460] Webserver started at http://127.29.69.130:45873/ using document root <none> and password file <none>
I20260806 15:07:45.828719 32014 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:45.828783 32014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:45.828928 32014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:45.829919 32014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "14fcd874215c4589b4f65be9cadcb336"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "78b444e356aa63a091a51a62c317a732"
server_key_iv: "cca6e08bc305f0e43ca84f500c973b15"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.830291 32014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "14fcd874215c4589b4f65be9cadcb336"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "78b444e356aa63a091a51a62c317a732"
server_key_iv: "cca6e08bc305f0e43ca84f500c973b15"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.831632 32014 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:45.832410 32032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:45.832592 32014 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:45.832691 32014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "14fcd874215c4589b4f65be9cadcb336"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "78b444e356aa63a091a51a62c317a732"
server_key_iv: "cca6e08bc305f0e43ca84f500c973b15"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.832778 32014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:45.848341 32014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:45.850230 32014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:45.850449 32014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:45.850984 32014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:45.851042 32014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:45.851083 32014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:45.851114 32014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:45.858834 32014 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:36579
I20260806 15:07:45.859251 32014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:45.859719 32148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:36579 every 8 connection(s)
I20260806 15:07:45.861090 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.851656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:58423 (local address 127.29.69.190:33663)
0806 15:07:45.851725 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:45.851727 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:45.851922 (+ 195us) server_negotiation.cc:407] Connection header received
0806 15:07:45.852430 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:45.852431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:45.852444 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:45.852499 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:45.853403 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.854265 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.855389 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.855631 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.855719 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.858119 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:45.858121 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:45.858121 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:45.858130 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:45.859971 (+ 1841us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.860357 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.860358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.860359 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.860422 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.860632 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.860632 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.860632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.860735 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:45.860789 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:45.860966 (+ 177us) server_negotiation.cc:299] Negotiation successful
0806 15:07:45.861027 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:07:45.861260 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.851651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.29.69.130:58423)
0806 15:07:45.851805 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:45.851839 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:45.852323 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:45.852571 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:45.852575 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:45.852959 (+ 384us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:45.853277 (+ 318us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.853284 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.854399 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.854401 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.855303 (+ 902us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.855307 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.855742 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.855744 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.855865 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.856381 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:45.856400 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:45.858013 (+ 1613us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:45.860048 (+ 2035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.860053 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.860054 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.860267 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.860491 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.860491 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.860491 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.860573 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.860781 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:45.860783 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:45.860879 (+ 96us) client_negotiation.cc:769] Sending connection context
0806 15:07:45.860951 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 15:07:45.861065 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":90,"threads_started":1}
I20260806 15:07:45.861739 32149 heartbeater.cc:347] Connected to a master server at 127.29.69.190:33663
I20260806 15:07:45.861822 32149 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:45.861996 32149 heartbeater.cc:511] Master 127.29.69.190:33663 requested a full tablet report, sending...
I20260806 15:07:45.862470 31790 ts_manager.cc:194] Registered new tserver with Master: 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579)
I20260806 15:07:45.862987 31790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:58423
I20260806 15:07:45.863771 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 32014
I20260806 15:07:45.863865 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:45.864060 29974 external_mini_cluster.cc:1428] Setting key 529e6ec97c80498abb8f3048e93d8d18
I20260806 15:07:45.869143 32156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.862776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.29.69.130:46017)
0806 15:07:45.863177 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:45.863189 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:45.863251 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:45.863401 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:45.863402 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:45.863555 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:45.863626 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.863628 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.864356 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.864357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.865150 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:45.865153 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.865483 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.865484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:45.865569 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.865983 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:45.865989 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:45.866427 (+ 438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:45.868111 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.868112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.868112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.868263 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.868480 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:45.868481 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:45.868481 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:45.868530 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:45.868877 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:45.868877 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:45.868927 (+ 50us) client_negotiation.cc:769] Sending connection context
0806 15:07:45.869000 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 15:07:45.869074 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":72,"threads_started":1}
I20260806 15:07:45.869413 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:45.862838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:46017 (local address 127.29.69.190:33663)
0806 15:07:45.862877 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:45.862878 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:45.863253 (+ 375us) server_negotiation.cc:407] Connection header received
0806 15:07:45.863307 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:45.863308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:45.863333 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:45.863384 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:45.863712 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.864273 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.865222 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:45.865410 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:45.865468 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:45.866524 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:45.866526 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:45.866527 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:45.866534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:45.868035 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.868330 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.868331 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.868332 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.868408 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:45.868592 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:45.868593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:45.868593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:45.868796 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:45.868872 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:45.869050 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 15:07:45.869131 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:45.889684 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:33663
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33571
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:45.970959 32159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:45.971158 32159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:45.971181 32159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:45.972301 32159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:45.972342 32159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:45.972362 32159 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260806 15:07:45.972419 32159 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:07:45.972452 32159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:45.973908 32159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33571
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:33663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:45.974140 32159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:45.974398 32159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:45.979197 32165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:45.979380 32159 server_base.cc:1034] running on GCE node
W20260806 15:07:45.979189 32166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:45.979212 32168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:45.979696 32159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:45.979887 32159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:45.981029 32159 hybrid_clock.cc:648] HybridClock initialized: now 1786028865981015 us; error 28 us; skew 500 ppm
Aug 06 15:07:45 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:45.983454 32159 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:45.983902 32159 webserver.cc:460] Webserver started at http://127.29.69.131:37029/ using document root <none> and password file <none>
I20260806 15:07:45.984138 32159 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:45.984186 32159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:45.984346 32159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:45.985357 32159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "3071875b490f4d1cb1e24ae2da6506bb"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "b99f52d05b2dc475bcb647f7af832d1d"
server_key_iv: "7ae6ace583ddc4f43b183ec5071246c8"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.985718 32159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "3071875b490f4d1cb1e24ae2da6506bb"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "b99f52d05b2dc475bcb647f7af832d1d"
server_key_iv: "7ae6ace583ddc4f43b183ec5071246c8"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.987076 32159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:45.987803 32176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:45.987993 32159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:45.988094 32159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "3071875b490f4d1cb1e24ae2da6506bb"
format_stamp: "Formatted at 2026-08-06 15:07:45 on dist-test-slave-tm1g"
server_key: "b99f52d05b2dc475bcb647f7af832d1d"
server_key_iv: "7ae6ace583ddc4f43b183ec5071246c8"
server_key_version: "encryptionkey@0"
I20260806 15:07:45.988166 32159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:46.012156 32159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:46.014041 32159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:46.014205 32159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:46.014808 32159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:46.014870 32159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:46.014915 32159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:46.014946 32159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 15:07:46 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:46.023186 32159 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:44327
I20260806 15:07:46.023276 32292 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:44327 every 8 connection(s)
I20260806 15:07:46.023612 32159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:07:46.024931 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 32159
I20260806 15:07:46.025020 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:46.025200 29974 external_mini_cluster.cc:1428] Setting key 93b578fa7107ee5f969c6ddd85a90737
I20260806 15:07:46.025679 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.015257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:39615 (local address 127.29.69.190:33663)
0806 15:07:46.015315 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.015317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.015553 (+ 236us) server_negotiation.cc:407] Connection header received
0806 15:07:46.016226 (+ 673us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.016227 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.016241 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.016313 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:46.017157 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.018226 (+ 1069us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.019292 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.019557 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.019651 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.022458 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:46.022460 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:46.022460 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:46.022467 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:46.024232 (+ 1765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.024616 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.024617 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.024618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.024668 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.024857 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.024858 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.024858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.025013 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:46.025095 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.025489 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.025588 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 15:07:46.025859 32185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.015243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.29.69.131:39615)
0806 15:07:46.015416 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.015454 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.015971 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.016401 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.016404 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.016751 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:46.017040 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.017046 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.018355 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.018357 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.019192 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.019195 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.019665 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.019666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.019806 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.020401 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:46.020409 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:46.022341 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:46.024309 (+ 1968us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:46.024313 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:46.024315 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:46.024548 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:46.024707 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:46.024708 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:46.024708 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:46.024791 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:46.025132 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:46.025140 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:46.025305 (+ 165us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.025458 (+ 153us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.025625 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260806 15:07:46.026343 32293 heartbeater.cc:347] Connected to a master server at 127.29.69.190:33663
I20260806 15:07:46.026434 32293 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:46.026608 32293 heartbeater.cc:511] Master 127.29.69.190:33663 requested a full tablet report, sending...
I20260806 15:07:46.026948 31790 ts_manager.cc:194] Registered new tserver with Master: 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:46.027422 31790 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:39615
I20260806 15:07:46.032512 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.027801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:57449 (local address 127.29.69.190:33663)
0806 15:07:46.027844 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.027846 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.027940 (+ 94us) server_negotiation.cc:407] Connection header received
0806 15:07:46.028006 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.028007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.028014 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.028053 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:46.028392 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.028850 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.029491 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.029664 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.029711 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.030531 (+ 820us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:46.030532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:46.030532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:46.030538 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:46.031667 (+ 1129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.031958 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.031959 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.031959 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.032008 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.032167 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.032167 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.032168 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.032257 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:46.032306 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.032406 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.032457 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:46.032537 32301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.027759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.29.69.131:57449)
0806 15:07:46.027883 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.027894 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.027952 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.028067 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.028068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.028263 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:46.028323 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.028325 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.028924 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.028924 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.029425 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.029427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.029724 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.029725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.029781 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.030122 (+ 341us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:46.030126 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:46.030461 (+ 335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:46.031735 (+ 1274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:46.031736 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:46.031736 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:46.031895 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:46.032063 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:46.032064 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:46.032064 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:46.032116 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:46.032307 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:46.032308 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:46.032343 (+ 35us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.032392 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.032474 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260806 15:07:46.037343 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 15:07:46 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 15:07:46 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028866, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:46.059365 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.052964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46360 (local address 127.29.69.190:33663)
0806 15:07:46.053016 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.053018 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.053034 (+ 16us) server_negotiation.cc:407] Connection header received
0806 15:07:46.053056 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.053056 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.053071 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.053123 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:46.053647 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.054121 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.054899 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.055086 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.055138 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.057283 (+ 2145us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:46.057284 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:46.057285 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:46.057291 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:46.058493 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.058789 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.058790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.058791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.058839 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.058998 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.058998 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.058998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.059094 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:46.059165 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.059248 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.059304 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 15:07:46.060856 31790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:46.062566 31790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:46.069568 32315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.065056 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:44327 (local address 127.0.0.1:39174)
0806 15:07:46.065507 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.065553 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.065642 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.065862 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.065865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.065867 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.065938 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.065940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.067309 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.067311 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.068345 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.068348 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.069241 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.069241 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.069337 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.069351 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.069423 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.069476 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":44,"threads_started":1}
I20260806 15:07:46.069618 32317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.065138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39174 (local address 127.29.69.131:44327)
0806 15:07:46.065309 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.065314 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.065623 (+ 309us) server_negotiation.cc:407] Connection header received
0806 15:07:46.065751 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.065754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.065771 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.065859 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.066027 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.067218 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.068446 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.069145 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.069221 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.069275 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.069450 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.069501 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260806 15:07:46.069784 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.065313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41158 (local address 127.29.69.130:36579)
0806 15:07:46.065575 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.065578 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.065899 (+ 321us) server_negotiation.cc:407] Connection header received
0806 15:07:46.065945 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.065948 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.065965 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.066042 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.066209 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.067310 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.068724 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.069252 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.069320 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.069377 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.069613 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.069662 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":95,"threads_started":1}
I20260806 15:07:46.069906 32316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.065059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:36579 (local address 127.0.0.1:41158)
0806 15:07:46.065791 (+ 732us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.065799 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.065843 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.066056 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.066057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.066067 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.066116 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.066117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.067392 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.067392 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.068616 (+ 1224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.068620 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.069411 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.069412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.069466 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.069468 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.069513 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.069544 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"mutex_wait_us":88,"thread_start_us":100,"threads_started":1}
I20260806 15:07:46.070161 32318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.065299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39252 (local address 127.29.69.129:40319)
0806 15:07:46.065501 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.065504 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.066193 (+ 689us) server_negotiation.cc:407] Connection header received
0806 15:07:46.066267 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.066269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.066283 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.066377 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.066571 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.067253 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.068712 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.069447 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.069513 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.069565 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.070006 (+ 441us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.070065 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":103,"threads_started":1}
I20260806 15:07:46.070402 32314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.065061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40319 (local address 127.0.0.1:39252)
0806 15:07:46.066121 (+ 1060us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.066130 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.066194 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.066445 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.066446 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.066448 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.066487 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.066488 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.067348 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.067349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.068634 (+ 1285us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.068635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.069604 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.069605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.069901 (+ 296us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.069908 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.070237 (+ 329us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.070284 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1051,"mutex_wait_us":34,"thread_start_us":87,"threads_started":1}
I20260806 15:07:46.070472 32226 tablet_service.cc:1467] Processing CreateTablet for tablet e403e083a4cb4a7e9e56b279a68cf588 (DEFAULT_TABLE table=test-table [id=587edb422ddc46098daf4d68003eb203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:46.070626 32082 tablet_service.cc:1467] Processing CreateTablet for tablet e403e083a4cb4a7e9e56b279a68cf588 (DEFAULT_TABLE table=test-table [id=587edb422ddc46098daf4d68003eb203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:46.070779 32226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e403e083a4cb4a7e9e56b279a68cf588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.070884 32082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e403e083a4cb4a7e9e56b279a68cf588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.073141 32320 tablet_bootstrap.cc:492] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Bootstrap starting.
I20260806 15:07:46.073781 32321 tablet_bootstrap.cc:492] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Bootstrap starting.
I20260806 15:07:46.073805 31935 tablet_service.cc:1467] Processing CreateTablet for tablet e403e083a4cb4a7e9e56b279a68cf588 (DEFAULT_TABLE table=test-table [id=587edb422ddc46098daf4d68003eb203]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:46.074069 32320 tablet_bootstrap.cc:654] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.074128 31935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e403e083a4cb4a7e9e56b279a68cf588. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.074452 32321 tablet_bootstrap.cc:654] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.074450 32320 log.cc:824] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:46.074827 32321 log.cc:824] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:46.075311 32320 tablet_bootstrap.cc:492] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: No bootstrap required, opened a new log
I20260806 15:07:46.075425 32320 ts_tablet_manager.cc:1397] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:07:46.075598 32321 tablet_bootstrap.cc:492] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: No bootstrap required, opened a new log
I20260806 15:07:46.075677 32321 ts_tablet_manager.cc:1397] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:07:46.076982 32321 raft_consensus.cc:348] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.077140 32321 raft_consensus.cc:374] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.077184 32321 raft_consensus.cc:729] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.077312 32321 consensus_queue.cc:260] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.077605 32149 heartbeater.cc:503] Master 127.29.69.190:33663 was elected leader, sending a full tablet report...
I20260806 15:07:46.077560 32320 raft_consensus.cc:348] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.077720 32320 raft_consensus.cc:374] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.077769 32320 raft_consensus.cc:729] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3071875b490f4d1cb1e24ae2da6506bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.077858 32321 ts_tablet_manager.cc:1428] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260806 15:07:46.077894 32320 consensus_queue.cc:260] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.078179 32320 ts_tablet_manager.cc:1428] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:46.078182 32325 tablet_bootstrap.cc:492] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Bootstrap starting.
I20260806 15:07:46.078290 32293 heartbeater.cc:503] Master 127.29.69.190:33663 was elected leader, sending a full tablet report...
I20260806 15:07:46.078896 32325 tablet_bootstrap.cc:654] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.079288 32325 log.cc:824] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:46.079510 32324 raft_consensus.cc:482] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:46.079614 32324 raft_consensus.cc:504] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.079965 32324 leader_election.cc:288] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327), 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319)
I20260806 15:07:46.080094 32325 tablet_bootstrap.cc:492] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: No bootstrap required, opened a new log
I20260806 15:07:46.080158 32325 ts_tablet_manager.cc:1397] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:46.082190 32325 raft_consensus.cc:348] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.082363 32325 raft_consensus.cc:374] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.082401 32325 raft_consensus.cc:729] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8695ef2b630547eda89868a4fe050c7c, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.082526 32325 consensus_queue.cc:260] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.082773 32041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.080098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:44327 (local address 127.29.69.130:49993)
0806 15:07:46.080158 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.080168 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.080210 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.080404 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.080405 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.080407 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.080472 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.080473 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.081164 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.081165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.081875 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.081877 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.082507 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.082508 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.082590 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.082611 (+ 21us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.082661 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.082703 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260806 15:07:46.082779 32325 ts_tablet_manager.cc:1428] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:46.082816 32003 heartbeater.cc:503] Master 127.29.69.190:33663 was elected leader, sending a full tablet report...
I20260806 15:07:46.082955 32317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.080117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:49993 (local address 127.29.69.131:44327)
0806 15:07:46.080279 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.080281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.080288 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:07:46.080308 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.080309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.080317 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.080364 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.080542 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.081074 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.081963 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.082400 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.082468 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.082476 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.082861 (+ 385us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.082901 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143}
I20260806 15:07:46.083395 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e403e083a4cb4a7e9e56b279a68cf588" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb" is_pre_election: true
I20260806 15:07:46.083540 32247 raft_consensus.cc:2454] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:46.083762 32318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.080298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:49873 (local address 127.29.69.129:40319)
0806 15:07:46.080337 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.080339 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.080368 (+ 29us) server_negotiation.cc:407] Connection header received
0806 15:07:46.080434 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.080434 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.080444 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.080498 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.080669 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.081346 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.082856 (+ 1510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.083362 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.083409 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.083417 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.083658 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.083708 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:07:46.083781 32033 leader_election.cc:302] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 3071875b490f4d1cb1e24ae2da6506bb; no voters:
I20260806 15:07:46.083889 32324 raft_consensus.cc:2781] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:46.083953 32324 raft_consensus.cc:482] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:46.083992 32324 raft_consensus.cc:3037] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.084059 32329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.080109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40319 (local address 127.29.69.130:49873)
0806 15:07:46.080314 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.080324 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.080383 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.080502 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.080503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.080504 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.080586 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.080588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.081620 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.081621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.082752 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.082755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.083496 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.083497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.083567 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.083571 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.083848 (+ 277us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.083892 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":80,"threads_started":1}
I20260806 15:07:46.084380 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e403e083a4cb4a7e9e56b279a68cf588" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c" is_pre_election: true
I20260806 15:07:46.084498 31954 raft_consensus.cc:2454] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:46.084853 32324 raft_consensus.cc:504] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.085042 32324 leader_election.cc:288] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Requested vote from peers 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327), 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319)
I20260806 15:07:46.085105 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e403e083a4cb4a7e9e56b279a68cf588" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb"
I20260806 15:07:46.085114 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e403e083a4cb4a7e9e56b279a68cf588" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c"
I20260806 15:07:46.085178 31954 raft_consensus.cc:3037] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.085180 32247 raft_consensus.cc:3037] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.085742 31954 raft_consensus.cc:2454] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:46.085906 32247 raft_consensus.cc:2454] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:46.086246 32035 leader_election.cc:302] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 8695ef2b630547eda89868a4fe050c7c; no voters:
I20260806 15:07:46.086387 32324 raft_consensus.cc:2781] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:46.086520 32324 raft_consensus.cc:686] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Becoming Leader. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Running, Role: LEADER
I20260806 15:07:46.086613 32324 consensus_queue.cc:237] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } }
I20260806 15:07:46.087356 31789 catalog_manager.cc:5495] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "14fcd874215c4589b4f65be9cadcb336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } health_report { overall_health: UNKNOWN } } }
W20260806 15:07:46.109935 32150 tablet.cc:2369] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 15:07:46 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028865, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:46.113498 32338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.106899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33663 (local address 127.0.0.1:46366)
0806 15:07:46.107075 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.107084 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.107162 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.107300 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.107301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.107603 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:46.107653 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.107657 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.108300 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.108302 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.108817 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.108819 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.109166 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.109167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.109225 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.109785 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:46.109789 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:46.111103 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:46.112414 (+ 1311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:46.112421 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:46.112423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:46.112613 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:46.112815 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:46.112816 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:46.112816 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:46.112873 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:46.113121 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:46.113129 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:46.113187 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.113253 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.113372 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":71,"threads_started":1}
I20260806 15:07:46.113548 31844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.106959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46366 (local address 127.29.69.190:33663)
0806 15:07:46.107021 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.107023 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.107148 (+ 125us) server_negotiation.cc:407] Connection header received
0806 15:07:46.107216 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.107217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.107227 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.107296 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:46.107740 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.108220 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.108899 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.109082 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.109165 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.111193 (+ 2028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:46.111194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:46.111194 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:46.111202 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:46.112324 (+ 1122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.112695 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.112696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.112697 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.112751 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:46.112941 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:46.112941 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:46.112942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:46.113050 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:46.113119 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.113288 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.113437 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":83,"server-negotiator.queue_time_us":33}
I20260806 15:07:46.115355 31789 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:46366:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 15:07:46.115587 31789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:46.117163 32082 tablet_service.cc:1467] Processing CreateTablet for tablet dc1abf5c61d3462ca814b928945982e9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6150c14299264b5a95d5fe61bee31ce2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:07:46.117167 32226 tablet_service.cc:1467] Processing CreateTablet for tablet dc1abf5c61d3462ca814b928945982e9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6150c14299264b5a95d5fe61bee31ce2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:07:46.117187 31935 tablet_service.cc:1467] Processing CreateTablet for tablet dc1abf5c61d3462ca814b928945982e9 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=6150c14299264b5a95d5fe61bee31ce2]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:07:46.117336 32226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1abf5c61d3462ca814b928945982e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.117336 31935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1abf5c61d3462ca814b928945982e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.117337 32082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dc1abf5c61d3462ca814b928945982e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.118503 32321 tablet_bootstrap.cc:492] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: Bootstrap starting.
I20260806 15:07:46.118850 32325 tablet_bootstrap.cc:492] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: Bootstrap starting.
I20260806 15:07:46.118957 32321 tablet_bootstrap.cc:654] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.119475 32325 tablet_bootstrap.cc:654] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.119660 32321 tablet_bootstrap.cc:492] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: No bootstrap required, opened a new log
I20260806 15:07:46.119722 32321 ts_tablet_manager.cc:1397] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:46.119903 32320 tablet_bootstrap.cc:492] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: Bootstrap starting.
I20260806 15:07:46.119897 32321 raft_consensus.cc:348] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.119977 32321 raft_consensus.cc:374] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.120008 32321 raft_consensus.cc:729] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.120071 32321 consensus_queue.cc:260] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.120178 32321 ts_tablet_manager.cc:1428] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:46.120270 32325 tablet_bootstrap.cc:492] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: No bootstrap required, opened a new log
I20260806 15:07:46.120328 32325 ts_tablet_manager.cc:1397] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:46.120329 32324 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.120419 32324 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:46.120478 32320 tablet_bootstrap.cc:654] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.120522 32325 raft_consensus.cc:348] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.120607 32325 raft_consensus.cc:374] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.120638 32325 raft_consensus.cc:729] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8695ef2b630547eda89868a4fe050c7c, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.120687 32325 consensus_queue.cc:260] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.120795 32325 ts_tablet_manager.cc:1428] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:46.120925 32330 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.121035 32330 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:46.121383 32320 tablet_bootstrap.cc:492] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: No bootstrap required, opened a new log
I20260806 15:07:46.121451 32320 ts_tablet_manager.cc:1397] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:46.121606 32320 raft_consensus.cc:348] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.121678 32320 raft_consensus.cc:374] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.121712 32320 raft_consensus.cc:729] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3071875b490f4d1cb1e24ae2da6506bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.121763 32320 consensus_queue.cc:260] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.121888 32320 ts_tablet_manager.cc:1428] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:46.121960 32326 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.122068 32326 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: This TxnStatusTablet replica's current role is: FOLLOWER
W20260806 15:07:46.201705 32004 tablet.cc:2369] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:07:46.274238 32294 tablet.cc:2369] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:46.310734 32330 raft_consensus.cc:482] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:46.310849 32330 raft_consensus.cc:504] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.311247 32330 leader_election.cc:288] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:46.314242 32317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.311547 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:42269 (local address 127.29.69.131:44327)
0806 15:07:46.311612 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.311615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.311710 (+ 95us) server_negotiation.cc:407] Connection header received
0806 15:07:46.311794 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.311795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.311802 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.311867 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.312026 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.312532 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.313520 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.313884 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.313937 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.313944 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.314118 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.314171 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 15:07:46.314239 32343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.311465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:44327 (local address 127.29.69.129:42269)
0806 15:07:46.311617 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.311629 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.311713 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.311873 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.311874 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.311877 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.311960 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.311962 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.312614 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.312615 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.313420 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.313422 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.313967 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.313968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.314038 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.314042 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.314095 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.314125 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"mutex_wait_us":3,"thread_start_us":70,"threads_started":1}
I20260806 15:07:46.314349 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.311556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:59379 (local address 127.29.69.130:36579)
0806 15:07:46.311607 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.311610 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.311660 (+ 50us) server_negotiation.cc:407] Connection header received
0806 15:07:46.311781 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.311783 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.311794 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.311860 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:46.312101 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.312580 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.313516 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.313897 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.313986 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.313994 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.314193 (+ 199us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.314237 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 15:07:46.314464 32342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.311465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:36579 (local address 127.29.69.129:59379)
0806 15:07:46.311600 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.311612 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.311702 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.311884 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.311885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.311887 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:46.312015 (+ 128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.312017 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.312679 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.312680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.313421 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.313423 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.314010 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.314011 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.314113 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.314117 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.314174 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.314211 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":6,"thread_start_us":64,"threads_started":1}
I20260806 15:07:46.314615 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1abf5c61d3462ca814b928945982e9" candidate_uuid: "8695ef2b630547eda89868a4fe050c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb" is_pre_election: true
I20260806 15:07:46.314731 32247 raft_consensus.cc:2454] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8695ef2b630547eda89868a4fe050c7c in term 0.
I20260806 15:07:46.314847 32103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1abf5c61d3462ca814b928945982e9" candidate_uuid: "8695ef2b630547eda89868a4fe050c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fcd874215c4589b4f65be9cadcb336" is_pre_election: true
I20260806 15:07:46.314973 32103 raft_consensus.cc:2454] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8695ef2b630547eda89868a4fe050c7c in term 0.
I20260806 15:07:46.314934 31885 leader_election.cc:302] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3071875b490f4d1cb1e24ae2da6506bb, 8695ef2b630547eda89868a4fe050c7c; no voters:
I20260806 15:07:46.315163 32330 raft_consensus.cc:2781] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:46.315215 32330 raft_consensus.cc:482] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:46.315236 32330 raft_consensus.cc:3037] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.315914 32330 raft_consensus.cc:504] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.316058 32330 leader_election.cc:288] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [CANDIDATE]: Term 1 election: Requested vote from peers 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:46.316231 32103 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1abf5c61d3462ca814b928945982e9" candidate_uuid: "8695ef2b630547eda89868a4fe050c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "14fcd874215c4589b4f65be9cadcb336"
I20260806 15:07:46.316320 32103 raft_consensus.cc:3037] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.316287 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dc1abf5c61d3462ca814b928945982e9" candidate_uuid: "8695ef2b630547eda89868a4fe050c7c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb"
I20260806 15:07:46.316354 32247 raft_consensus.cc:3037] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.317118 32247 raft_consensus.cc:2454] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8695ef2b630547eda89868a4fe050c7c in term 1.
I20260806 15:07:46.317239 32103 raft_consensus.cc:2454] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8695ef2b630547eda89868a4fe050c7c in term 1.
I20260806 15:07:46.317299 31885 leader_election.cc:302] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3071875b490f4d1cb1e24ae2da6506bb, 8695ef2b630547eda89868a4fe050c7c; no voters:
I20260806 15:07:46.317413 32330 raft_consensus.cc:2781] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:46.317556 32330 raft_consensus.cc:686] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [term 1 LEADER]: Becoming Leader. State: Replica: 8695ef2b630547eda89868a4fe050c7c, State: Running, Role: LEADER
I20260806 15:07:46.317662 32330 consensus_queue.cc:237] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.318087 32344 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: TxnStatusTablet state changed. Reason: New leader 8695ef2b630547eda89868a4fe050c7c. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.318182 32344 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:07:46.318395 32346 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 15:07:46.318511 32346 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 15:07:46.318514 31789 catalog_manager.cc:5495] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c reported cstate change: term changed from 0 to 1, leader changed from <none> to 8695ef2b630547eda89868a4fe050c7c (127.29.69.129). New cstate: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:46.347994 32338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.345046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40319 (local address 127.0.0.1:39266)
0806 15:07:46.345120 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.345133 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.345198 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.345389 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.345390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.345391 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:07:46.345438 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.345440 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.346388 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.346393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.347030 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.347033 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.347517 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.347519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.347570 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.347584 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.347857 (+ 273us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.347863 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.347891 (+ 28us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.347935 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:07:46.347996 32318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.345128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39266 (local address 127.29.69.129:40319)
0806 15:07:46.345180 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.345182 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.345193 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:07:46.345265 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.345266 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.345291 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.345371 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:46.345498 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.346268 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.347110 (+ 842us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.347438 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.347511 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.347668 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.347791 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.347872 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.347894 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.347917 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:07:46.349726 32247 raft_consensus.cc:1261] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Refusing update from remote peer 8695ef2b630547eda89868a4fe050c7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:46.349751 32103 raft_consensus.cc:1261] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Refusing update from remote peer 8695ef2b630547eda89868a4fe050c7c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:46.350040 32344 consensus_queue.cc:1035] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:46.350186 32330 consensus_queue.cc:1035] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c [LEADER]: Connected to new peer: Peer: permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:46.351372 32324 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: TxnStatusTablet state changed. Reason: New leader 8695ef2b630547eda89868a4fe050c7c. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.351481 32324 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:46.351490 32326 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: TxnStatusTablet state changed. Reason: New leader 8695ef2b630547eda89868a4fe050c7c. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.351606 32326 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:46.352548 32326 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.352583 32344 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.352648 32326 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 3071875b490f4d1cb1e24ae2da6506bb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:46.352670 32344 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:07:46.352682 32349 mvcc.cc:205] Tried to move back new op lower bound from 7315574236566020096 to 7315574236437733376. Current Snapshot: MvccSnapshot[applied={T|T < 7315574236566020096}]
I20260806 15:07:46.353183 32324 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.353263 32324 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 14fcd874215c4589b4f65be9cadcb336: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:07:46.352612 32330 tablet_replica.cc:439] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8695ef2b630547eda89868a4fe050c7c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } } }
I20260806 15:07:46.353511 32330 tablet_replica.cc:442] T dc1abf5c61d3462ca814b928945982e9 P 8695ef2b630547eda89868a4fe050c7c: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:07:46.354058 32350 mvcc.cc:205] Tried to move back new op lower bound from 7315574236566020096 to 7315574236437733376. Current Snapshot: MvccSnapshot[applied={T|T < 7315574236566020096}]
I20260806 15:07:46.354386 32351 mvcc.cc:205] Tried to move back new op lower bound from 7315574236566020096 to 7315574236437733376. Current Snapshot: MvccSnapshot[applied={T|T < 7315574236566020096}]
I20260806 15:07:46.357477 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.354889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41172 (local address 127.29.69.130:36579)
0806 15:07:46.354929 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.354931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.354939 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:07:46.354992 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.354993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.355011 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.355080 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:46.355260 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.355705 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.356805 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.356989 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.357051 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.357218 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.357301 (+ 83us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.357351 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.357414 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.357430 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:07:46.362528 32318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.359876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:59261 (local address 127.29.69.129:40319)
0806 15:07:46.359923 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.359924 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.359996 (+ 72us) server_negotiation.cc:407] Connection header received
0806 15:07:46.360067 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.360068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.360074 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.360117 (+ 43us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:46.360275 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.360746 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.361823 (+ 1077us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.362011 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.362062 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.362268 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.362292 (+ 24us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.362371 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.362437 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.362456 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:07:46.362540 32156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.359807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40319 (local address 127.29.69.130:59261)
0806 15:07:46.359946 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.359958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.360011 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.360124 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.360124 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.360126 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:07:46.360190 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.360192 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.360830 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.360831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.361746 (+ 915us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.361749 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.362082 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.362083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.362154 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.362170 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.362374 (+ 204us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.362375 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.362424 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.362468 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260806 15:07:46.364986 32247 raft_consensus.cc:1261] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:46.365106 31954 raft_consensus.cc:1261] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:46.365324 32324 consensus_queue.cc:1035] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:46.365502 32331 consensus_queue.cc:1035] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:46.374013 32319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.371503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:38851 (local address 127.29.69.130:36579)
0806 15:07:46.371542 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:46.371543 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:46.371552 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:46.371604 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:46.371605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:46.371614 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:46.371669 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:46.371829 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.372280 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.373344 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.373543 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.373618 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.373801 (+ 183us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.373833 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.373880 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:46.373929 (+ 49us) server_negotiation.cc:299] Negotiation successful
0806 15:07:46.373948 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:07:46.374058 32366 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:46.371323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:36579 (local address 127.29.69.129:38851)
0806 15:07:46.371473 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:46.371486 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:46.371548 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:46.371672 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:46.371672 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:46.371674 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:07:46.371749 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.371751 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.372363 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.372364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.373261 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:46.373264 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:46.373630 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:46.373631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:46.373693 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:46.373714 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:07:46.373879 (+ 165us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:07:46.373881 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:07:46.373926 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 15:07:46.373968 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":64,"threads_started":1}
I20260806 15:07:46.383159 31788 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:46.383262 31788 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:46.384050 31788 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Sending DeleteTablet for 3 replicas of tablet e403e083a4cb4a7e9e56b279a68cf588
I20260806 15:07:46.384403 32226 tablet_service.cc:1514] Processing DeleteTablet for tablet e403e083a4cb4a7e9e56b279a68cf588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:46 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39174
I20260806 15:07:46.384392 32082 tablet_service.cc:1514] Processing DeleteTablet for tablet e403e083a4cb4a7e9e56b279a68cf588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:46 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:41158
I20260806 15:07:46.384953 31935 tablet_service.cc:1514] Processing DeleteTablet for tablet e403e083a4cb4a7e9e56b279a68cf588 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:46 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39252
I20260806 15:07:46.385185 32371 tablet_replica.cc:330] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: stopping tablet replica
I20260806 15:07:46.385167 31788 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:46.385309 31788 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:46.385525 32371 raft_consensus.cc:2229] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:46.385655 32371 raft_consensus.cc:2258] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:46.386147 32371 ts_tablet_manager.cc:1905] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:46.386394 32226 tablet_service.cc:1467] Processing CreateTablet for tablet 90563d9d33e946b39641a1cc0e7b188e (DEFAULT_TABLE table=test-table [id=4a4331a9be4e4e83a1f422368da4425f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:46.386518 32226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90563d9d33e946b39641a1cc0e7b188e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.387853 32320 tablet_bootstrap.cc:492] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Bootstrap starting.
I20260806 15:07:46.388240 32371 ts_tablet_manager.cc:1918] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:46.388309 32320 tablet_bootstrap.cc:654] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.388412 32371 log.cc:1196] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/e403e083a4cb4a7e9e56b279a68cf588
I20260806 15:07:46.388756 32371 ts_tablet_manager.cc:1939] T e403e083a4cb4a7e9e56b279a68cf588 P 8695ef2b630547eda89868a4fe050c7c: Deleting consensus metadata
I20260806 15:07:46.388903 32082 tablet_service.cc:1467] Processing CreateTablet for tablet 90563d9d33e946b39641a1cc0e7b188e (DEFAULT_TABLE table=test-table [id=4a4331a9be4e4e83a1f422368da4425f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:46.389025 32082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90563d9d33e946b39641a1cc0e7b188e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.390424 32321 tablet_bootstrap.cc:492] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Bootstrap starting.
I20260806 15:07:46.390614 31775 catalog_manager.cc:4841] TS 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319): tablet e403e083a4cb4a7e9e56b279a68cf588 (table test-table [id=587edb422ddc46098daf4d68003eb203]) successfully deleted
I20260806 15:07:46.390863 32321 tablet_bootstrap.cc:654] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.391371 31935 tablet_service.cc:1467] Processing CreateTablet for tablet 90563d9d33e946b39641a1cc0e7b188e (DEFAULT_TABLE table=test-table [id=4a4331a9be4e4e83a1f422368da4425f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:46.391417 32320 tablet_bootstrap.cc:492] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: No bootstrap required, opened a new log
I20260806 15:07:46.391474 31935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90563d9d33e946b39641a1cc0e7b188e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:46.391484 32320 ts_tablet_manager.cc:1397] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 15:07:46.391644 32320 raft_consensus.cc:348] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.391708 32320 raft_consensus.cc:374] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.391731 32320 raft_consensus.cc:729] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3071875b490f4d1cb1e24ae2da6506bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.391767 32320 consensus_queue.cc:260] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.391865 32320 ts_tablet_manager.cc:1428] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:46.392701 32325 tablet_bootstrap.cc:492] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Bootstrap starting.
I20260806 15:07:46.392756 32369 tablet_replica.cc:330] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: stopping tablet replica
I20260806 15:07:46.392867 32369 raft_consensus.cc:2229] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:46.392966 32325 tablet_bootstrap.cc:654] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:46.392968 32369 raft_consensus.cc:2258] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:46.393410 32321 tablet_bootstrap.cc:492] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: No bootstrap required, opened a new log
I20260806 15:07:46.393468 32321 ts_tablet_manager.cc:1397] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 15:07:46.393501 32370 tablet_replica.cc:330] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: stopping tablet replica
I20260806 15:07:46.393616 32370 raft_consensus.cc:2229] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:46.393613 32321 raft_consensus.cc:348] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.393674 32321 raft_consensus.cc:374] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.393674 32370 raft_consensus.cc:2258] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:46.393697 32321 raft_consensus.cc:729] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.393743 32321 consensus_queue.cc:260] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.393826 32321 ts_tablet_manager.cc:1428] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:46.394665 32325 tablet_bootstrap.cc:492] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: No bootstrap required, opened a new log
I20260806 15:07:46.394733 32325 ts_tablet_manager.cc:1397] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:46.393419 32369 ts_tablet_manager.cc:1905] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:46.394899 32325 raft_consensus.cc:348] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.394982 32325 raft_consensus.cc:374] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:46.395011 32325 raft_consensus.cc:729] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8695ef2b630547eda89868a4fe050c7c, State: Initialized, Role: FOLLOWER
I20260806 15:07:46.395066 32325 consensus_queue.cc:260] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.395154 32325 ts_tablet_manager.cc:1428] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:46.397276 32370 ts_tablet_manager.cc:1905] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:46.398952 32370 ts_tablet_manager.cc:1918] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:46.399037 32370 log.cc:1196] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/e403e083a4cb4a7e9e56b279a68cf588
I20260806 15:07:46.399312 32370 ts_tablet_manager.cc:1939] T e403e083a4cb4a7e9e56b279a68cf588 P 3071875b490f4d1cb1e24ae2da6506bb: Deleting consensus metadata
I20260806 15:07:46.399708 32369 ts_tablet_manager.cc:1918] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:46.399786 32369 log.cc:1196] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/e403e083a4cb4a7e9e56b279a68cf588
I20260806 15:07:46.400048 32369 ts_tablet_manager.cc:1939] T e403e083a4cb4a7e9e56b279a68cf588 P 14fcd874215c4589b4f65be9cadcb336: Deleting consensus metadata
I20260806 15:07:46.400426 31774 catalog_manager.cc:4841] TS 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579): tablet e403e083a4cb4a7e9e56b279a68cf588 (table test-table [id=587edb422ddc46098daf4d68003eb203]) successfully deleted
I20260806 15:07:46.400931 31773 catalog_manager.cc:4841] TS 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327): tablet e403e083a4cb4a7e9e56b279a68cf588 (table test-table [id=587edb422ddc46098daf4d68003eb203]) successfully deleted
I20260806 15:07:46.649534 32364 raft_consensus.cc:482] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:46.649679 32364 raft_consensus.cc:504] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.649919 32364 leader_election.cc:288] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:46.650197 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90563d9d33e946b39641a1cc0e7b188e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb" is_pre_election: true
I20260806 15:07:46.650200 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90563d9d33e946b39641a1cc0e7b188e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c" is_pre_election: true
I20260806 15:07:46.650303 32247 raft_consensus.cc:2454] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:46.650344 31954 raft_consensus.cc:2454] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:46.650504 32033 leader_election.cc:302] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 3071875b490f4d1cb1e24ae2da6506bb; no voters:
I20260806 15:07:46.650609 32364 raft_consensus.cc:2781] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:46.650652 32364 raft_consensus.cc:482] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:46.650678 32364 raft_consensus.cc:3037] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.651584 32364 raft_consensus.cc:504] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.651728 32364 leader_election.cc:288] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Requested vote from peers 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:46.651873 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90563d9d33e946b39641a1cc0e7b188e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c"
I20260806 15:07:46.651880 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90563d9d33e946b39641a1cc0e7b188e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb"
I20260806 15:07:46.651970 31954 raft_consensus.cc:3037] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.651971 32247 raft_consensus.cc:3037] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:46.652669 32247 raft_consensus.cc:2454] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:46.652760 31954 raft_consensus.cc:2454] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:46.652894 32033 leader_election.cc:302] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 3071875b490f4d1cb1e24ae2da6506bb; no voters:
I20260806 15:07:46.653014 32364 raft_consensus.cc:2781] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:46.653071 32364 raft_consensus.cc:686] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Becoming Leader. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Running, Role: LEADER
I20260806 15:07:46.653131 32364 consensus_queue.cc:237] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:46.653816 31788 catalog_manager.cc:5495] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "14fcd874215c4589b4f65be9cadcb336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:46.678709 31954 raft_consensus.cc:1261] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:46.678699 32247 raft_consensus.cc:1261] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:46.678920 32364 consensus_queue.cc:1035] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:46.679054 32324 consensus_queue.cc:1035] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 15:07:46.683795 32350 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 15:07:48.201603 31790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:48.201704 31790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46360:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:48.202735 31790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Sending DeleteTablet for 3 replicas of tablet 90563d9d33e946b39641a1cc0e7b188e
I20260806 15:07:48.203045 32082 tablet_service.cc:1514] Processing DeleteTablet for tablet 90563d9d33e946b39641a1cc0e7b188e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:48 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:41158
I20260806 15:07:48.203066 32226 tablet_service.cc:1514] Processing DeleteTablet for tablet 90563d9d33e946b39641a1cc0e7b188e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:48 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39174
I20260806 15:07:48.203256 31935 tablet_service.cc:1514] Processing DeleteTablet for tablet 90563d9d33e946b39641a1cc0e7b188e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:48 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39252
I20260806 15:07:48.203397 32399 tablet_replica.cc:330] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: stopping tablet replica
I20260806 15:07:48.203469 32399 raft_consensus.cc:2229] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:48.203475 32400 tablet_replica.cc:330] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: stopping tablet replica
I20260806 15:07:48.203521 32399 raft_consensus.cc:2258] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:48.203526 32400 raft_consensus.cc:2229] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:48.203560 32400 raft_consensus.cc:2258] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:48.203665 32398 tablet_replica.cc:330] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: stopping tablet replica
I20260806 15:07:48.203729 32398 raft_consensus.cc:2229] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:48.203840 32399 ts_tablet_manager.cc:1905] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:48.203923 32400 ts_tablet_manager.cc:1905] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:48.205525 32398 raft_consensus.cc:2258] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:48.205636 32399 ts_tablet_manager.cc:1918] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 15:07:48.205672 32400 ts_tablet_manager.cc:1918] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 15:07:48.205699 32399 log.cc:1196] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/90563d9d33e946b39641a1cc0e7b188e
I20260806 15:07:48.205727 32400 log.cc:1196] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/90563d9d33e946b39641a1cc0e7b188e
I20260806 15:07:48.205947 32399 ts_tablet_manager.cc:1939] T 90563d9d33e946b39641a1cc0e7b188e P 3071875b490f4d1cb1e24ae2da6506bb: Deleting consensus metadata
I20260806 15:07:48.205947 32400 ts_tablet_manager.cc:1939] T 90563d9d33e946b39641a1cc0e7b188e P 8695ef2b630547eda89868a4fe050c7c: Deleting consensus metadata
I20260806 15:07:48.206136 32398 ts_tablet_manager.cc:1905] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:48.206532 31775 catalog_manager.cc:4841] TS 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319): tablet 90563d9d33e946b39641a1cc0e7b188e (table test-table [id=4a4331a9be4e4e83a1f422368da4425f]) successfully deleted
I20260806 15:07:48.206557 31773 catalog_manager.cc:4841] TS 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327): tablet 90563d9d33e946b39641a1cc0e7b188e (table test-table [id=4a4331a9be4e4e83a1f422368da4425f]) successfully deleted
I20260806 15:07:48.207572 32398 ts_tablet_manager.cc:1918] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 15:07:48.207671 32398 log.cc:1196] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/90563d9d33e946b39641a1cc0e7b188e
I20260806 15:07:48.207911 32398 ts_tablet_manager.cc:1939] T 90563d9d33e946b39641a1cc0e7b188e P 14fcd874215c4589b4f65be9cadcb336: Deleting consensus metadata
I20260806 15:07:48.208294 31774 catalog_manager.cc:4841] TS 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579): tablet 90563d9d33e946b39641a1cc0e7b188e (table test-table [id=4a4331a9be4e4e83a1f422368da4425f]) successfully deleted
Aug 06 15:07:48 dist-test-slave-tm1g krb5kdc[31742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028868, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 15:07:48 dist-test-slave-tm1g krb5kdc[31742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028868, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:48.231467 32408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:48.220558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46368 (local address 127.29.69.190:33663)
0806 15:07:48.220715 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:48.220717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:48.220743 (+ 26us) server_negotiation.cc:407] Connection header received
0806 15:07:48.220847 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:48.220848 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:48.220861 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:48.220929 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:48.221565 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:48.222093 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:48.223025 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:48.223241 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:48.223325 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:48.228978 (+ 5653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:48.228980 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:48.228980 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:48.228988 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:48.230288 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:48.230666 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:48.230668 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:48.230668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:48.230733 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:48.230935 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:48.230935 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:48.230936 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:48.231059 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:48.231172 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:48.231271 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 15:07:48.231355 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260806 15:07:48.233016 31790 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:48.233162 31790 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:48.234457 32082 tablet_service.cc:1467] Processing CreateTablet for tablet 5147baf05e4d4751a42afab28e99ecfa (DEFAULT_TABLE table=test-table [id=1efb4a42a6ac48ee91aa5d29a1bb2ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:48.234486 32226 tablet_service.cc:1467] Processing CreateTablet for tablet 5147baf05e4d4751a42afab28e99ecfa (DEFAULT_TABLE table=test-table [id=1efb4a42a6ac48ee91aa5d29a1bb2ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:48.234606 32082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5147baf05e4d4751a42afab28e99ecfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:48.234613 32226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5147baf05e4d4751a42afab28e99ecfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:48.235716 32409 tablet_bootstrap.cc:492] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Bootstrap starting.
I20260806 15:07:48.235776 31935 tablet_service.cc:1467] Processing CreateTablet for tablet 5147baf05e4d4751a42afab28e99ecfa (DEFAULT_TABLE table=test-table [id=1efb4a42a6ac48ee91aa5d29a1bb2ec0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:48.235903 31935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5147baf05e4d4751a42afab28e99ecfa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:48.236164 32409 tablet_bootstrap.cc:654] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:48.236757 32409 tablet_bootstrap.cc:492] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: No bootstrap required, opened a new log
I20260806 15:07:48.236824 32409 ts_tablet_manager.cc:1397] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:48.236948 32409 raft_consensus.cc:348] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.237023 32409 raft_consensus.cc:374] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:48.237043 32409 raft_consensus.cc:729] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Initialized, Role: FOLLOWER
I20260806 15:07:48.237108 32409 consensus_queue.cc:260] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.237232 32409 ts_tablet_manager.cc:1428] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:48.237438 32412 tablet_bootstrap.cc:492] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Bootstrap starting.
I20260806 15:07:48.237708 32410 tablet_bootstrap.cc:492] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Bootstrap starting.
I20260806 15:07:48.237892 32412 tablet_bootstrap.cc:654] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:48.238183 32410 tablet_bootstrap.cc:654] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:48.238502 32412 tablet_bootstrap.cc:492] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: No bootstrap required, opened a new log
I20260806 15:07:48.238580 32412 ts_tablet_manager.cc:1397] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:48.238718 32412 raft_consensus.cc:348] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.238793 32412 raft_consensus.cc:374] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:48.238827 32412 raft_consensus.cc:729] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8695ef2b630547eda89868a4fe050c7c, State: Initialized, Role: FOLLOWER
I20260806 15:07:48.238849 32410 tablet_bootstrap.cc:492] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: No bootstrap required, opened a new log
I20260806 15:07:48.238899 32410 ts_tablet_manager.cc:1397] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:48.238881 32412 consensus_queue.cc:260] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.238986 32412 ts_tablet_manager.cc:1428] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:48.239027 32410 raft_consensus.cc:348] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.239107 32410 raft_consensus.cc:374] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:48.239138 32410 raft_consensus.cc:729] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3071875b490f4d1cb1e24ae2da6506bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:48.239209 32410 consensus_queue.cc:260] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.239393 32410 ts_tablet_manager.cc:1428] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:48.314404 32324 raft_consensus.cc:482] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:48.314534 32324 raft_consensus.cc:504] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.314754 32324 leader_election.cc:288] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:48.314966 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5147baf05e4d4751a42afab28e99ecfa" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c" is_pre_election: true
I20260806 15:07:48.315032 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5147baf05e4d4751a42afab28e99ecfa" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb" is_pre_election: true
I20260806 15:07:48.315096 31954 raft_consensus.cc:2454] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:48.315112 32247 raft_consensus.cc:2454] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:48.315289 32035 leader_election.cc:302] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 8695ef2b630547eda89868a4fe050c7c; no voters:
I20260806 15:07:48.315399 32324 raft_consensus.cc:2781] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:48.315474 32324 raft_consensus.cc:482] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:48.315506 32324 raft_consensus.cc:3037] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:48.316198 32324 raft_consensus.cc:504] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.316345 32324 leader_election.cc:288] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Requested vote from peers 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:48.316499 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5147baf05e4d4751a42afab28e99ecfa" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb"
I20260806 15:07:48.316573 32247 raft_consensus.cc:3037] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:48.316515 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5147baf05e4d4751a42afab28e99ecfa" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c"
I20260806 15:07:48.316612 31954 raft_consensus.cc:3037] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:48.317234 32247 raft_consensus.cc:2454] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:48.317303 31954 raft_consensus.cc:2454] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:48.317402 32033 leader_election.cc:302] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 3071875b490f4d1cb1e24ae2da6506bb; no voters:
I20260806 15:07:48.317531 32324 raft_consensus.cc:2781] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:48.317619 32324 raft_consensus.cc:686] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Becoming Leader. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Running, Role: LEADER
I20260806 15:07:48.317678 32324 consensus_queue.cc:237] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.318295 31789 catalog_manager.cc:5495] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "14fcd874215c4589b4f65be9cadcb336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:48.333917 32418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:48.331559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41174 (local address 127.29.69.130:36579)
0806 15:07:48.331699 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:48.331701 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:48.331707 (+ 6us) server_negotiation.cc:407] Connection header received
0806 15:07:48.331729 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:48.331730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:48.331741 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:48.331817 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:48.331971 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:48.332460 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:48.333233 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:48.333451 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:48.333524 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:48.333670 (+ 146us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:48.333706 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:48.333760 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:48.333813 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 15:07:48.333836 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260806 15:07:48.335943 31954 raft_consensus.cc:1261] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:48.335959 32247 raft_consensus.cc:1261] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:48.336165 32390 consensus_queue.cc:1035] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:48.336259 32324 consensus_queue.cc:1035] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:48.345989 31789 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:48.346081 31789 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:48.346698 31789 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Sending DeleteTablet for 3 replicas of tablet 5147baf05e4d4751a42afab28e99ecfa
I20260806 15:07:48.346968 32082 tablet_service.cc:1514] Processing DeleteTablet for tablet 5147baf05e4d4751a42afab28e99ecfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:48 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:41158
I20260806 15:07:48.346973 32226 tablet_service.cc:1514] Processing DeleteTablet for tablet 5147baf05e4d4751a42afab28e99ecfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:48 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39174
I20260806 15:07:48.347100 32398 tablet_replica.cc:330] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: stopping tablet replica
I20260806 15:07:48.347088 31935 tablet_service.cc:1514] Processing DeleteTablet for tablet 5147baf05e4d4751a42afab28e99ecfa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:48 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39252
I20260806 15:07:48.347170 32398 raft_consensus.cc:2229] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:48.347177 32400 tablet_replica.cc:330] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: stopping tablet replica
I20260806 15:07:48.347229 32398 raft_consensus.cc:2258] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:48.347232 32400 raft_consensus.cc:2229] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:48.347272 32400 raft_consensus.cc:2258] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:48.347306 32399 tablet_replica.cc:330] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: stopping tablet replica
I20260806 15:07:48.347369 32399 raft_consensus.cc:2229] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:48.347410 32399 raft_consensus.cc:2258] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:48.347630 32400 ts_tablet_manager.cc:1905] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:48.347800 32398 ts_tablet_manager.cc:1905] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:48.347805 32399 ts_tablet_manager.cc:1905] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:48.348965 31789 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46368:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:48.349161 31789 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:48.349262 32400 ts_tablet_manager.cc:1918] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:48.349270 32399 ts_tablet_manager.cc:1918] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:48.349327 32399 log.cc:1196] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/5147baf05e4d4751a42afab28e99ecfa
I20260806 15:07:48.349327 32400 log.cc:1196] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/5147baf05e4d4751a42afab28e99ecfa
I20260806 15:07:48.349507 32398 ts_tablet_manager.cc:1918] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:07:48.349555 32399 ts_tablet_manager.cc:1939] T 5147baf05e4d4751a42afab28e99ecfa P 3071875b490f4d1cb1e24ae2da6506bb: Deleting consensus metadata
I20260806 15:07:48.349556 32400 ts_tablet_manager.cc:1939] T 5147baf05e4d4751a42afab28e99ecfa P 8695ef2b630547eda89868a4fe050c7c: Deleting consensus metadata
I20260806 15:07:48.349581 32398 log.cc:1196] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/5147baf05e4d4751a42afab28e99ecfa
I20260806 15:07:48.349848 32398 ts_tablet_manager.cc:1939] T 5147baf05e4d4751a42afab28e99ecfa P 14fcd874215c4589b4f65be9cadcb336: Deleting consensus metadata
I20260806 15:07:48.349869 31773 catalog_manager.cc:4841] TS 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327): tablet 5147baf05e4d4751a42afab28e99ecfa (table test-table [id=1efb4a42a6ac48ee91aa5d29a1bb2ec0]) successfully deleted
I20260806 15:07:48.350205 31774 catalog_manager.cc:4841] TS 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579): tablet 5147baf05e4d4751a42afab28e99ecfa (table test-table [id=1efb4a42a6ac48ee91aa5d29a1bb2ec0]) successfully deleted
I20260806 15:07:48.350240 31775 catalog_manager.cc:4841] TS 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319): tablet 5147baf05e4d4751a42afab28e99ecfa (table test-table [id=1efb4a42a6ac48ee91aa5d29a1bb2ec0]) successfully deleted
I20260806 15:07:48.350575 31935 tablet_service.cc:1467] Processing CreateTablet for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e (DEFAULT_TABLE table=test-table [id=4d6f9be0c19d4dec90fb1ab43b486bec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:48.350574 32226 tablet_service.cc:1467] Processing CreateTablet for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e (DEFAULT_TABLE table=test-table [id=4d6f9be0c19d4dec90fb1ab43b486bec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:48.350577 32082 tablet_service.cc:1467] Processing CreateTablet for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e (DEFAULT_TABLE table=test-table [id=4d6f9be0c19d4dec90fb1ab43b486bec]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:48.350687 31935 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:48.350692 32226 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:48.350708 32082 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:48.351866 32412 tablet_bootstrap.cc:492] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c: Bootstrap starting.
I20260806 15:07:48.352197 32412 tablet_bootstrap.cc:654] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:48.352306 32409 tablet_bootstrap.cc:492] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Bootstrap starting.
I20260806 15:07:48.352576 32409 tablet_bootstrap.cc:654] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:48.353103 32412 tablet_bootstrap.cc:492] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c: No bootstrap required, opened a new log
I20260806 15:07:48.353137 32412 ts_tablet_manager.cc:1397] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:48.353142 32409 tablet_bootstrap.cc:492] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: No bootstrap required, opened a new log
I20260806 15:07:48.353188 32409 ts_tablet_manager.cc:1397] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260806 15:07:48.353269 32412 raft_consensus.cc:348] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.353314 32412 raft_consensus.cc:374] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:48.353327 32412 raft_consensus.cc:729] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8695ef2b630547eda89868a4fe050c7c, State: Initialized, Role: FOLLOWER
I20260806 15:07:48.353305 32409 raft_consensus.cc:348] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.353374 32409 raft_consensus.cc:374] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:48.353396 32409 raft_consensus.cc:729] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Initialized, Role: FOLLOWER
I20260806 15:07:48.353389 32412 consensus_queue.cc:260] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.353447 32409 consensus_queue.cc:260] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.353482 32412 ts_tablet_manager.cc:1428] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:48.353549 32409 ts_tablet_manager.cc:1428] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:48.354391 32410 tablet_bootstrap.cc:492] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Bootstrap starting.
I20260806 15:07:48.354662 32410 tablet_bootstrap.cc:654] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:48.355216 32410 tablet_bootstrap.cc:492] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: No bootstrap required, opened a new log
I20260806 15:07:48.355281 32410 ts_tablet_manager.cc:1397] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:48.355535 32410 raft_consensus.cc:348] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.355611 32410 raft_consensus.cc:374] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:48.355641 32410 raft_consensus.cc:729] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3071875b490f4d1cb1e24ae2da6506bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:48.355682 32410 consensus_queue.cc:260] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.355784 32410 ts_tablet_manager.cc:1428] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:48.694380 32324 raft_consensus.cc:482] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:48.694490 32324 raft_consensus.cc:504] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.694646 32324 leader_election.cc:288] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:48.694922 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d1cd9fe6884f1a95cc6a5bf8714b6e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb" is_pre_election: true
I20260806 15:07:48.694927 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d1cd9fe6884f1a95cc6a5bf8714b6e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c" is_pre_election: true
I20260806 15:07:48.695034 32247 raft_consensus.cc:2454] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:48.695034 31954 raft_consensus.cc:2454] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 0.
I20260806 15:07:48.695192 32035 leader_election.cc:302] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 8695ef2b630547eda89868a4fe050c7c; no voters:
I20260806 15:07:48.695309 32324 raft_consensus.cc:2781] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:48.695350 32324 raft_consensus.cc:482] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:48.695374 32324 raft_consensus.cc:3037] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:48.696084 32324 raft_consensus.cc:504] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.696233 32324 leader_election.cc:288] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Requested vote from peers 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319), 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327)
I20260806 15:07:48.696393 32247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d1cd9fe6884f1a95cc6a5bf8714b6e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3071875b490f4d1cb1e24ae2da6506bb"
I20260806 15:07:48.696475 32247 raft_consensus.cc:3037] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:48.696408 31954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73d1cd9fe6884f1a95cc6a5bf8714b6e" candidate_uuid: "14fcd874215c4589b4f65be9cadcb336" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8695ef2b630547eda89868a4fe050c7c"
I20260806 15:07:48.696516 31954 raft_consensus.cc:3037] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:48.697121 32247 raft_consensus.cc:2454] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:48.697248 31954 raft_consensus.cc:2454] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 14fcd874215c4589b4f65be9cadcb336 in term 1.
I20260806 15:07:48.697311 32033 leader_election.cc:302] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 14fcd874215c4589b4f65be9cadcb336, 3071875b490f4d1cb1e24ae2da6506bb; no voters:
I20260806 15:07:48.697409 32324 raft_consensus.cc:2781] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:48.697464 32324 raft_consensus.cc:686] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Becoming Leader. State: Replica: 14fcd874215c4589b4f65be9cadcb336, State: Running, Role: LEADER
I20260806 15:07:48.697520 32324 consensus_queue.cc:237] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } }
I20260806 15:07:48.698175 31789 catalog_manager.cc:5495] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 reported cstate change: term changed from 0 to 1, leader changed from <none> to 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "14fcd874215c4589b4f65be9cadcb336" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "14fcd874215c4589b4f65be9cadcb336" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:48.709254 32247 raft_consensus.cc:1261] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:48.709292 31954 raft_consensus.cc:1261] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Refusing update from remote peer 14fcd874215c4589b4f65be9cadcb336: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:48.709478 32324 consensus_queue.cc:1035] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3071875b490f4d1cb1e24ae2da6506bb" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 44327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:48.709573 32422 consensus_queue.cc:1035] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8695ef2b630547eda89868a4fe050c7c" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 15:07:48.713832 32382 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260806 15:07:50.231477 31790 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:50.231580 31790 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46368:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:50.232457 31790 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d11e061d2c324d3e92017a06a40fd4c4: Sending DeleteTablet for 3 replicas of tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e
I20260806 15:07:50.232723 31935 tablet_service.cc:1514] Processing DeleteTablet for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:50 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39252
I20260806 15:07:50.232743 32082 tablet_service.cc:1514] Processing DeleteTablet for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:50 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:41158
I20260806 15:07:50.232815 32226 tablet_service.cc:1514] Processing DeleteTablet for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:50 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:39174
I20260806 15:07:50.232970 32455 tablet_replica.cc:330] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c: stopping tablet replica
I20260806 15:07:50.233040 32455 raft_consensus.cc:2229] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:50.233086 32455 raft_consensus.cc:2258] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 8695ef2b630547eda89868a4fe050c7c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:50.233096 32457 tablet_replica.cc:330] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: stopping tablet replica
I20260806 15:07:50.233161 32457 raft_consensus.cc:2229] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:50.233204 32457 raft_consensus.cc:2258] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:50.233206 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 31868
I20260806 15:07:50.235065 32457 ts_tablet_manager.cc:1905] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:50.236699 32457 ts_tablet_manager.cc:1918] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 15:07:50.236778 32457 log.cc:1196] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/73d1cd9fe6884f1a95cc6a5bf8714b6e
I20260806 15:07:50.236994 32457 ts_tablet_manager.cc:1939] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 3071875b490f4d1cb1e24ae2da6506bb: Deleting consensus metadata
I20260806 15:07:50.237609 31773 catalog_manager.cc:4841] TS 3071875b490f4d1cb1e24ae2da6506bb (127.29.69.131:44327): tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e (table test-table [id=4d6f9be0c19d4dec90fb1ab43b486bec]) successfully deleted
I20260806 15:07:50.238430 32456 tablet_replica.cc:330] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: stopping tablet replica
I20260806 15:07:50.238493 32456 raft_consensus.cc:2229] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:50.238561 32456 raft_consensus.cc:2258] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:50.238768 32456 ts_tablet_manager.cc:1905] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:50.240231 32456 ts_tablet_manager.cc:1918] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260806 15:07:50.240281 32456 log.cc:1196] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/73d1cd9fe6884f1a95cc6a5bf8714b6e
I20260806 15:07:50.240542 32456 ts_tablet_manager.cc:1939] T 73d1cd9fe6884f1a95cc6a5bf8714b6e P 14fcd874215c4589b4f65be9cadcb336: Deleting consensus metadata
I20260806 15:07:50.240870 31774 catalog_manager.cc:4841] TS 14fcd874215c4589b4f65be9cadcb336 (127.29.69.130:36579): tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e (table test-table [id=4d6f9be0c19d4dec90fb1ab43b486bec]) successfully deleted
W20260806 15:07:50.242285 31775 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:40319 (error 108)
I20260806 15:07:50.242894 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 32014
I20260806 15:07:50.243186 32459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:50.242779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40319 (local address 127.0.0.1:55780)
0806 15:07:50.243087 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:50.243141 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:40319: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":281,"thread_start_us":65,"threads_started":1}
W20260806 15:07:50.245671 31775 catalog_manager.cc:4584] TS 8695ef2b630547eda89868a4fe050c7c (127.29.69.129:40319): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 73d1cd9fe6884f1a95cc6a5bf8714b6e: Network error: Client connection negotiation failed: client connection to 127.29.69.129:40319: connect: Connection refused (error 111)
I20260806 15:07:50.251582 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 32159
I20260806 15:07:50.258193 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 31756
2026-08-06T15:07:50Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6070 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:50 dist-test-slave-tm1g krb5kdc[32462](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:50 dist-test-slave-tm1g krb5kdc[32462](info): set up 2 sockets
Aug 06 15:07:50 dist-test-slave-tm1g krb5kdc[32462](info): commencing operation
krb5kdc: starting...
W20260806 15:07:51.318825 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:51.432538 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42263
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:42263
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:51.527024 32477 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:51.527258 32477 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:51.527297 32477 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:51.528507 32477 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:51.528571 32477 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:51.528599 32477 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:51.528631 32477 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:51.528661 32477 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:51.530479 32477 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:42263
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42263
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32477
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:51.530745 32477 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:51.530980 32477 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:51.536216 32486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:51.536332 32483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:51.536331 32482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:51.536315 32477 server_base.cc:1034] running on GCE node
I20260806 15:07:51.536721 32477 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:51.537039 32477 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:51.538208 32477 hybrid_clock.cc:648] HybridClock initialized: now 1786028871538201 us; error 35 us; skew 500 ppm
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:51.540606 32477 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:51.541070 32477 webserver.cc:460] Webserver started at http://127.29.69.190:38851/ using document root <none> and password file <none>
I20260806 15:07:51.541314 32477 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:51.541381 32477 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:51.541536 32477 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:51.542625 32477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "edcfdaaf2e2b4fcab975e603a6fc5066"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "680aabffb6514fc745715b6e2254c920"
server_key_iv: "10fa66dc489935079a11f645e0c34a84"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.542980 32477 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "edcfdaaf2e2b4fcab975e603a6fc5066"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "680aabffb6514fc745715b6e2254c920"
server_key_iv: "10fa66dc489935079a11f645e0c34a84"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.544456 32477 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:51.545215 32493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.545416 32477 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:51.545521 32477 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "edcfdaaf2e2b4fcab975e603a6fc5066"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "680aabffb6514fc745715b6e2254c920"
server_key_iv: "10fa66dc489935079a11f645e0c34a84"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.545603 32477 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:51.564368 32477 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:51.566164 32477 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:51.566383 32477 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:51.576243 32477 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:42263
I20260806 15:07:51.576424 32545 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:42263 every 8 connection(s)
I20260806 15:07:51.576756 32477 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:51.577018 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 32477
I20260806 15:07:51.577119 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:51.577340 29974 external_mini_cluster.cc:1428] Setting key 422081d59c7b65ed6f5b7144087ee30a
I20260806 15:07:51.578342 32546 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:51.583012 32546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066: Bootstrap starting.
I20260806 15:07:51.584621 32546 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:51.585489 32546 log.cc:824] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066: Log is configured to *not* fsync() on all Append() calls
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:51.586514 32546 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066: No bootstrap required, opened a new log
I20260806 15:07:51.590864 32546 raft_consensus.cc:348] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42263 } }
I20260806 15:07:51.591078 32546 raft_consensus.cc:374] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:51.591148 32546 raft_consensus.cc:729] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edcfdaaf2e2b4fcab975e603a6fc5066, State: Initialized, Role: FOLLOWER
I20260806 15:07:51.591336 32549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:51.577912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57502 (local address 127.29.69.190:42263)
0806 15:07:51.578296 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:51.578345 (+ 49us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:51.578410 (+ 65us) server_negotiation.cc:407] Connection header received
0806 15:07:51.579187 (+ 777us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:51.579194 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:51.579243 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:51.579358 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:51.580362 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.581586 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.582842 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.583362 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.583451 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:51.587013 (+ 3562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:51.587018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:51.587018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:51.587030 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:51.589529 (+ 2499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:51.589876 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:51.589879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:51.589880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:51.590022 (+ 142us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:51.590232 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:51.590233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:51.590233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:51.590654 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:51.590837 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:51.590911 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 15:07:51.591049 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":308,"thread_start_us":235,"threads_started":1}
I20260806 15:07:51.591293 32546 consensus_queue.cc:260] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42263 } }
I20260806 15:07:51.591416 32546 raft_consensus.cc:388] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:51.591454 32546 raft_consensus.cc:482] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:51.591492 32546 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:51.592300 32546 raft_consensus.cc:504] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42263 } }
I20260806 15:07:51.592423 32546 leader_election.cc:302] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edcfdaaf2e2b4fcab975e603a6fc5066; no voters:
I20260806 15:07:51.592588 32546 leader_election.cc:288] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:51.592741 32551 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:51.592954 32546 sys_catalog.cc:564] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:51.592993 32551 raft_consensus.cc:686] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [term 1 LEADER]: Becoming Leader. State: Replica: edcfdaaf2e2b4fcab975e603a6fc5066, State: Running, Role: LEADER
I20260806 15:07:51.593099 32551 consensus_queue.cc:237] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42263 } }
I20260806 15:07:51.593765 32552 sys_catalog.cc:455] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42263 } } }
I20260806 15:07:51.593788 32553 sys_catalog.cc:455] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edcfdaaf2e2b4fcab975e603a6fc5066. Latest consensus state: current_term: 1 leader_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edcfdaaf2e2b4fcab975e603a6fc5066" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42263 } } }
I20260806 15:07:51.593851 32552 sys_catalog.cc:458] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:51.593883 32553 sys_catalog.cc:458] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:51.594602 32558 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:51.595465 32558 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:51.597573 32558 catalog_manager.cc:1347] Generated new cluster ID: 9c4186cae6af4e9f9020537028d535f8
I20260806 15:07:51.597635 32558 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:07:51.607791 32558 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:51.608381 32558 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:51.616729 32558 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edcfdaaf2e2b4fcab975e603a6fc5066: Generated new TSK 0
I20260806 15:07:51.616906 32558 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:51.648958 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42263
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:51.731190 32572 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:51.731416 32572 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:51.731457 32572 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:51.732708 32572 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:51.732772 32572 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:51.732817 32572 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:51.734256 32572 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32572
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:51.734540 32572 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:51.734768 32572 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:51.740005 32577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:51.740084 32578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:51.740047 32581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:51.742378 32572 server_base.cc:1034] running on GCE node
I20260806 15:07:51.742587 32572 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:51.742812 32572 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:51.746044 32572 hybrid_clock.cc:648] HybridClock initialized: now 1786028871746014 us; error 32 us; skew 500 ppm
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:51.749621 32572 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:51.750165 32572 webserver.cc:460] Webserver started at http://127.29.69.129:44845/ using document root <none> and password file <none>
I20260806 15:07:51.750456 32572 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:51.750504 32572 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:51.750591 32572 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:51.751693 32572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "453b8dde0fdc45f180f7fe3d1ec3aa67"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "682995f53ac7e8021fc8f4b3ade8c16b"
server_key_iv: "476b9a713a2d3272d1bc26fb80194699"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.752010 32572 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "453b8dde0fdc45f180f7fe3d1ec3aa67"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "682995f53ac7e8021fc8f4b3ade8c16b"
server_key_iv: "476b9a713a2d3272d1bc26fb80194699"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.753316 32572 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:51.754030 32588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.754187 32572 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.754281 32572 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "453b8dde0fdc45f180f7fe3d1ec3aa67"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "682995f53ac7e8021fc8f4b3ade8c16b"
server_key_iv: "476b9a713a2d3272d1bc26fb80194699"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.754383 32572 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:51.772491 32572 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:51.774746 32572 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:51.774857 32572 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:51.775027 32572 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:51.775274 32572 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:51.775307 32572 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.775327 32572 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:51.775341 32572 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.780973 32572 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:39601
I20260806 15:07:51.781065 32708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:39601 every 8 connection(s)
I20260806 15:07:51.781368 32572 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:51.784591 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 32572
I20260806 15:07:51.784693 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:51.784870 29974 external_mini_cluster.cc:1428] Setting key 4203bfdf10edc22835e2de9987c2eb41
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:51.790514 32549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:51.782117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:37423 (local address 127.29.69.190:42263)
0806 15:07:51.782188 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:51.782191 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:51.782459 (+ 268us) server_negotiation.cc:407] Connection header received
0806 15:07:51.782916 (+ 457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:51.782917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:51.782927 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:51.782980 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:51.783829 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.784322 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.785400 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.785681 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.785762 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:51.787832 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:51.787833 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:51.787834 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:51.787841 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:51.789132 (+ 1291us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:51.789543 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:51.789545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:51.789545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:51.789604 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:51.789855 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:51.789856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:51.789856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:51.789970 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:51.790056 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:51.790337 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 15:07:51.790425 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 15:07:51.790710 32711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:51.782083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42263 (local address 127.29.69.129:37423)
0806 15:07:51.782286 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:51.782363 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:51.782835 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:51.783040 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:51.783043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:51.783571 (+ 528us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:51.783753 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:51.783758 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.784397 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.784398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:51.785307 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:51.785310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.785784 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.785786 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:51.785915 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:51.786420 (+ 505us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:51.786427 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:51.787736 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:51.789216 (+ 1480us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:51.789223 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:51.789225 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:51.789446 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:51.789677 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:51.789678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:51.789678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:51.789787 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:51.790046 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:51.790053 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:51.790189 (+ 136us) client_negotiation.cc:769] Sending connection context
0806 15:07:51.790297 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 15:07:51.790462 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":113,"threads_started":1}
I20260806 15:07:51.791265 32709 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42263
I20260806 15:07:51.791369 32709 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:51.791543 32709 heartbeater.cc:511] Master 127.29.69.190:42263 requested a full tablet report, sending...
I20260806 15:07:51.792069 32510 ts_manager.cc:194] Registered new tserver with Master: 453b8dde0fdc45f180f7fe3d1ec3aa67 (127.29.69.129:39601)
I20260806 15:07:51.792707 32510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:37423
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:51.809278 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42263
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:51.889951 32715 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:51.890151 32715 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:51.890174 32715 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:51.891319 32715 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:51.891359 32715 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:51.891386 32715 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:51.892802 32715 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32715
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:51.893069 32715 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:51.893267 32715 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:51.898294 32723 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:51.898383 32715 server_base.cc:1034] running on GCE node
W20260806 15:07:51.898343 32720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:51.898309 32721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:51.898734 32715 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:51.898981 32715 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:51.900141 32715 hybrid_clock.cc:648] HybridClock initialized: now 1786028871900124 us; error 29 us; skew 500 ppm
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:51.902999 32715 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:51.903474 32715 webserver.cc:460] Webserver started at http://127.29.69.130:39659/ using document root <none> and password file <none>
I20260806 15:07:51.903712 32715 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:51.903779 32715 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:51.903936 32715 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:51.904964 32715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "ec501a83058c4ba6a4b8f848653e82d8"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "1c683ea09986fa2616462a1b61407b93"
server_key_iv: "535fb22b8e221ca6a44d92ba2cfefcea"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.905328 32715 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "ec501a83058c4ba6a4b8f848653e82d8"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "1c683ea09986fa2616462a1b61407b93"
server_key_iv: "535fb22b8e221ca6a44d92ba2cfefcea"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.906755 32715 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:51.907480 32731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.907655 32715 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:51.907757 32715 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "ec501a83058c4ba6a4b8f848653e82d8"
format_stamp: "Formatted at 2026-08-06 15:07:51 on dist-test-slave-tm1g"
server_key: "1c683ea09986fa2616462a1b61407b93"
server_key_iv: "535fb22b8e221ca6a44d92ba2cfefcea"
server_key_version: "encryptionkey@0"
I20260806 15:07:51.907830 32715 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:51.921717 32715 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:51.924090 32715 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:51.924275 32715 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:51.924511 32715 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:51.924813 32715 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:51.924865 32715 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.924896 32715 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:51.924924 32715 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:51.931304 32715 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:34035
I20260806 15:07:51.931356 379 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:34035 every 8 connection(s)
I20260806 15:07:51.931663 32715 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:51.933632 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 32715
I20260806 15:07:51.933748 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:51.933915 29974 external_mini_cluster.cc:1428] Setting key 3642148ab3acd00c3c6c00314b6a51b9
Aug 06 15:07:51 dist-test-slave-tm1g krb5kdc[32462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028871, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:51.941792 32549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:51.932331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:51507 (local address 127.29.69.190:42263)
0806 15:07:51.932382 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:51.932385 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:51.932579 (+ 194us) server_negotiation.cc:407] Connection header received
0806 15:07:51.933112 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:51.933113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:51.933124 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:51.933183 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:51.934236 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.934789 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.935795 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.936014 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.936101 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:51.938581 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:51.938582 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:51.938583 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:51.938589 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:51.940175 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:51.940698 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:51.940699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:51.940699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:51.940752 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:51.941034 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:51.941034 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:51.941034 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:51.941153 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:51.941203 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:51.941549 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 15:07:51.941671 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:07:51.941989 382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:51.932289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42263 (local address 127.29.69.130:51507)
0806 15:07:51.932444 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:51.932491 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:51.933002 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:51.933251 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:51.933255 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:51.933894 (+ 639us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:51.934139 (+ 245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:51.934144 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.934889 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.934890 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:51.935697 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:51.935700 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:51.936113 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:51.936114 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:51.936266 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:51.936765 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:51.936773 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:51.938488 (+ 1715us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:51.940269 (+ 1781us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:51.940277 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:51.940279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:51.940620 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:51.940817 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:51.940818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:51.940819 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:51.940966 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:51.941220 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:51.941227 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:51.941398 (+ 171us) client_negotiation.cc:769] Sending connection context
0806 15:07:51.941532 (+ 134us) client_negotiation.cc:240] Negotiation successful
0806 15:07:51.941738 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":66,"threads_started":1}
I20260806 15:07:51.942627 380 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42263
I20260806 15:07:51.942734 380 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:51.942936 380 heartbeater.cc:511] Master 127.29.69.190:42263 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
I20260806 15:07:51.943325 32510 ts_manager.cc:194] Registered new tserver with Master: ec501a83058c4ba6a4b8f848653e82d8 (127.29.69.130:34035)
I20260806 15:07:51.943714 32510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:51507
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:51.959434 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42263
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43535
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:52.040028 385 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:52.040221 385 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:52.040244 385 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:52.041320 385 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:52.041355 385 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:52.041381 385 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:52.042922 385 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43535
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42263
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:52.043116 385 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:52.043280 385 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:52.048465 391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:52.048554 390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:52.048700 385 server_base.cc:1034] running on GCE node
W20260806 15:07:52.048457 394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:52.049036 385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:52.049371 385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:52.050563 385 hybrid_clock.cc:648] HybridClock initialized: now 1786028872050528 us; error 49 us; skew 500 ppm
Aug 06 15:07:52 dist-test-slave-tm1g krb5kdc[32462](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028872, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:52.053089 385 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:52.053584 385 webserver.cc:460] Webserver started at http://127.29.69.131:41179/ using document root <none> and password file <none>
I20260806 15:07:52.053798 385 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:52.053840 385 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:52.053943 385 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:52.055015 385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "20c0cbe5c10045a3b22575a2afa795a6"
format_stamp: "Formatted at 2026-08-06 15:07:52 on dist-test-slave-tm1g"
server_key: "5093a4d44fe02fe399137052e802aaf4"
server_key_iv: "02fd15b5c7a3516adc1e8ae9a2ef6817"
server_key_version: "encryptionkey@0"
I20260806 15:07:52.055328 385 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "20c0cbe5c10045a3b22575a2afa795a6"
format_stamp: "Formatted at 2026-08-06 15:07:52 on dist-test-slave-tm1g"
server_key: "5093a4d44fe02fe399137052e802aaf4"
server_key_iv: "02fd15b5c7a3516adc1e8ae9a2ef6817"
server_key_version: "encryptionkey@0"
I20260806 15:07:52.056609 385 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:52.057471 401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:52.057642 385 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:52.057750 385 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "20c0cbe5c10045a3b22575a2afa795a6"
format_stamp: "Formatted at 2026-08-06 15:07:52 on dist-test-slave-tm1g"
server_key: "5093a4d44fe02fe399137052e802aaf4"
server_key_iv: "02fd15b5c7a3516adc1e8ae9a2ef6817"
server_key_version: "encryptionkey@0"
I20260806 15:07:52.057824 385 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:52.074798 385 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:52.076854 385 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:52.077020 385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:52.077261 385 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:52.077584 385 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:52.077639 385 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:52.077682 385 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:52.077708 385 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:52.083710 385 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36713
I20260806 15:07:52.083755 518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36713 every 8 connection(s)
I20260806 15:07:52.084112 385 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:07:52 dist-test-slave-tm1g krb5kdc[32462](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028872, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:52.093112 32549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:52.084822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:36415 (local address 127.29.69.190:42263)
0806 15:07:52.084888 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:52.084890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:52.085098 (+ 208us) server_negotiation.cc:407] Connection header received
0806 15:07:52.085592 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:52.085593 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:52.085603 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:52.085666 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:52.086638 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:52.087138 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:52.088079 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:52.088259 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:52.088309 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:52.090376 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:52.090377 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:52.090377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:52.090384 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:52.091814 (+ 1430us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:52.092195 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:52.092195 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:52.092196 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:52.092244 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:52.092501 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:52.092501 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:52.092502 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:52.092613 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:52.092662 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:52.092932 (+ 270us) server_negotiation.cc:299] Negotiation successful
0806 15:07:52.093048 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:07:52.093236 521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:52.084798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42263 (local address 127.29.69.131:36415)
0806 15:07:52.084969 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:52.085011 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:52.085509 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:52.085721 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:52.085724 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:52.086282 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:52.086554 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:52.086559 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:52.087217 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:52.087217 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:52.088007 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:52.088008 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:52.088329 (+ 321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:52.088330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:52.088429 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:52.088876 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:52.088884 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:52.090234 (+ 1350us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:52.091902 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:52.091908 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:52.091910 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:52.092125 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:52.092327 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:52.092328 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:52.092329 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:52.092442 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:52.092667 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:52.092673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:52.092784 (+ 111us) client_negotiation.cc:769] Sending connection context
0806 15:07:52.092872 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 15:07:52.093031 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260806 15:07:52.093811 519 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42263
I20260806 15:07:52.093895 519 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:52.094118 519 heartbeater.cc:511] Master 127.29.69.190:42263 requested a full tablet report, sending...
I20260806 15:07:52.094350 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 385
I20260806 15:07:52.094478 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:52.094566 32510 ts_manager.cc:194] Registered new tserver with Master: 20c0cbe5c10045a3b22575a2afa795a6 (127.29.69.131:36713)
I20260806 15:07:52.094702 29974 external_mini_cluster.cc:1428] Setting key 7ab98efe65ca05c9b3395a78c22880de
I20260806 15:07:52.095011 32510 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:36415
I20260806 15:07:52.095599 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 15:07:52.107683 32549 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:07:52.106861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57518 (local address 127.29.69.190:42263)
0806 15:07:52.106927 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:52.106931 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:52.107041 (+ 110us) server_negotiation.cc:407] Connection header received
0806 15:07:52.107086 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:52.107087 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:52.107095 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:52.107150 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:52.107635 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57518: BlockingRecv error: recv got EOF from 127.0.0.1:57518 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260806 15:07:52.108616 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 32572
I20260806 15:07:52.113730 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 32715
I20260806 15:07:52.118701 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 385
I20260806 15:07:52.123606 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 32477
2026-08-06T15:07:52Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1863 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:52 dist-test-slave-tm1g krb5kdc[531](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:52 dist-test-slave-tm1g krb5kdc[531](info): set up 2 sockets
Aug 06 15:07:52 dist-test-slave-tm1g krb5kdc[531](info): commencing operation
krb5kdc: starting...
W20260806 15:07:53.166612 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.022s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:53 dist-test-slave-tm1g krb5kdc[531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:53.280727 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40541
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:39511
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:40541
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:53.360373 544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:53.360628 544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:53.360668 544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:53.361822 544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:53.361888 544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:53.361910 544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:53.361930 544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:53.361963 544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:53.363447 544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39511
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:40541
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40541
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:53.363708 544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:53.363930 544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:53.368752 549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:53.368768 550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:53.368798 552 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:53.369064 544 server_base.cc:1034] running on GCE node
I20260806 15:07:53.369341 544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:53.369601 544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:53.370740 544 hybrid_clock.cc:648] HybridClock initialized: now 1786028873370720 us; error 37 us; skew 500 ppm
Aug 06 15:07:53 dist-test-slave-tm1g krb5kdc[531](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028873, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:53.377861 544 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:53.378257 544 webserver.cc:460] Webserver started at http://127.29.69.190:43049/ using document root <none> and password file <none>
I20260806 15:07:53.378505 544 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:53.378554 544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:53.378645 544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:53.379665 544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "d845c29abce7427ba1d7119ccc81d352"
format_stamp: "Formatted at 2026-08-06 15:07:53 on dist-test-slave-tm1g"
server_key: "78e8d50e2244e4d013e92e6f9ce9ecd5"
server_key_iv: "737adf13fdd87a766986321d12d20016"
server_key_version: "encryptionkey@0"
I20260806 15:07:53.379979 544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "d845c29abce7427ba1d7119ccc81d352"
format_stamp: "Formatted at 2026-08-06 15:07:53 on dist-test-slave-tm1g"
server_key: "78e8d50e2244e4d013e92e6f9ce9ecd5"
server_key_iv: "737adf13fdd87a766986321d12d20016"
server_key_version: "encryptionkey@0"
I20260806 15:07:53.381265 544 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:53.382037 560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:53.382257 544 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:53.382385 544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "d845c29abce7427ba1d7119ccc81d352"
format_stamp: "Formatted at 2026-08-06 15:07:53 on dist-test-slave-tm1g"
server_key: "78e8d50e2244e4d013e92e6f9ce9ecd5"
server_key_iv: "737adf13fdd87a766986321d12d20016"
server_key_version: "encryptionkey@0"
I20260806 15:07:53.382472 544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:53.395315 544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:53.397608 544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:53.397773 544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:53.401950 544 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:40541
I20260806 15:07:53.402007 613 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:40541 every 8 connection(s)
I20260806 15:07:53.402590 544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:53.403301 614 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:53.405011 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 544
I20260806 15:07:53.405117 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:53.405279 29974 external_mini_cluster.cc:1428] Setting key 52c2ff24086ecefa39c30445b6c3c6ff
I20260806 15:07:53.405995 614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352: Bootstrap starting.
I20260806 15:07:53.406741 614 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:53.407120 614 log.cc:824] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:53.407862 614 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352: No bootstrap required, opened a new log
I20260806 15:07:53.410084 614 raft_consensus.cc:348] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d845c29abce7427ba1d7119ccc81d352" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40541 } }
I20260806 15:07:53.410265 614 raft_consensus.cc:374] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:53.410342 614 raft_consensus.cc:729] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d845c29abce7427ba1d7119ccc81d352, State: Initialized, Role: FOLLOWER
I20260806 15:07:53.410470 614 consensus_queue.cc:260] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d845c29abce7427ba1d7119ccc81d352" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40541 } }
I20260806 15:07:53.410573 614 raft_consensus.cc:388] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:53.410630 614 raft_consensus.cc:482] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:53.410677 614 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:53.411417 614 raft_consensus.cc:504] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d845c29abce7427ba1d7119ccc81d352" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40541 } }
I20260806 15:07:53.411535 614 leader_election.cc:302] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d845c29abce7427ba1d7119ccc81d352; no voters:
I20260806 15:07:53.411697 614 leader_election.cc:288] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:53.411770 619 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:53.411929 619 raft_consensus.cc:686] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [term 1 LEADER]: Becoming Leader. State: Replica: d845c29abce7427ba1d7119ccc81d352, State: Running, Role: LEADER
I20260806 15:07:53.411986 614 sys_catalog.cc:564] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:53.412031 619 consensus_queue.cc:237] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d845c29abce7427ba1d7119ccc81d352" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40541 } }
I20260806 15:07:53.412348 619 sys_catalog.cc:455] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d845c29abce7427ba1d7119ccc81d352. Latest consensus state: current_term: 1 leader_uuid: "d845c29abce7427ba1d7119ccc81d352" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d845c29abce7427ba1d7119ccc81d352" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40541 } } }
I20260806 15:07:53.412442 619 sys_catalog.cc:458] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [sys.catalog]: This master's current role is: LEADER
Aug 06 15:07:53 dist-test-slave-tm1g krb5kdc[531](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028873, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:53.412358 620 sys_catalog.cc:455] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d845c29abce7427ba1d7119ccc81d352" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d845c29abce7427ba1d7119ccc81d352" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40541 } } }
I20260806 15:07:53.412611 620 sys_catalog.cc:458] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:53.412673 626 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:53.413159 626 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:53.415086 626 catalog_manager.cc:1347] Generated new cluster ID: 2a209d8ab65547ef83e26c049aa236a5
I20260806 15:07:53.415136 626 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:07:53.416795 617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:53.405819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50926 (local address 127.29.69.190:40541)
0806 15:07:53.405993 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:53.406000 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:53.406025 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:07:53.406486 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:53.406493 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:53.406540 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:53.406654 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:53.407473 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:53.408466 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:53.409560 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:53.409958 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:53.410037 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:53.413091 (+ 3054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:53.413095 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:53.413095 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:53.413110 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:53.415180 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:53.415594 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:53.415596 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:53.415597 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:53.415693 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:53.415915 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:53.415915 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:53.415915 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:53.416187 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:53.416307 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:53.416463 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 15:07:53.416586 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
I20260806 15:07:53.417778 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:07:53.425033 626 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:53.425836 626 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:53.434260 617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:53.430048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50938 (local address 127.29.69.190:40541)
0806 15:07:53.430087 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:53.430089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:53.430192 (+ 103us) server_negotiation.cc:407] Connection header received
0806 15:07:53.430238 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:53.430239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:53.430251 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:53.430343 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:53.430807 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:53.431567 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:53.432648 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:53.432957 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:53.433015 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:53.433790 (+ 775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:53.433791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:53.433791 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:53.433990 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:53.434006 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:53.434013 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:53.434065 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:53.434161 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 15:07:53.434185 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:53.435333 626 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d845c29abce7427ba1d7119ccc81d352: Generated new TSK 0
I20260806 15:07:53.435482 626 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:07:53.442873 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 544
2026-08-06T15:07:53Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1317 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:53 dist-test-slave-tm1g krb5kdc[648](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:53 dist-test-slave-tm1g krb5kdc[648](info): set up 2 sockets
Aug 06 15:07:53 dist-test-slave-tm1g krb5kdc[648](info): commencing operation
krb5kdc: starting...
W20260806 15:07:54.486570 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:54 dist-test-slave-tm1g krb5kdc[648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:54.598953 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:41463
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:41463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:54.679749 663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:54.679991 663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:54.680032 663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:54.681161 663 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:54.681229 663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:54.681252 663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:54.681272 663 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:54.681301 663 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:54.682803 663 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:41463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:41463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:54.683082 663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:54.683301 663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:54.688069 671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:54.688112 663 server_base.cc:1034] running on GCE node
W20260806 15:07:54.688077 668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:54.688086 669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:54.688532 663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:54.688808 663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:54.689951 663 hybrid_clock.cc:648] HybridClock initialized: now 1786028874689932 us; error 38 us; skew 500 ppm
Aug 06 15:07:54 dist-test-slave-tm1g krb5kdc[648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028874, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:54.692476 663 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:54.692900 663 webserver.cc:460] Webserver started at http://127.29.69.190:46035/ using document root <none> and password file <none>
I20260806 15:07:54.693136 663 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:54.693205 663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:54.693341 663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:54.694403 663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "fcc652e1e74040fa80463ede856df0bb"
format_stamp: "Formatted at 2026-08-06 15:07:54 on dist-test-slave-tm1g"
server_key: "8045c71c74a5214652340df179065a8c"
server_key_iv: "0f7fa11f7fc656e657028337ed836f79"
server_key_version: "encryptionkey@0"
I20260806 15:07:54.694769 663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "fcc652e1e74040fa80463ede856df0bb"
format_stamp: "Formatted at 2026-08-06 15:07:54 on dist-test-slave-tm1g"
server_key: "8045c71c74a5214652340df179065a8c"
server_key_iv: "0f7fa11f7fc656e657028337ed836f79"
server_key_version: "encryptionkey@0"
I20260806 15:07:54.696087 663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:54.696842 678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:54.697021 663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:54.697127 663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "fcc652e1e74040fa80463ede856df0bb"
format_stamp: "Formatted at 2026-08-06 15:07:54 on dist-test-slave-tm1g"
server_key: "8045c71c74a5214652340df179065a8c"
server_key_iv: "0f7fa11f7fc656e657028337ed836f79"
server_key_version: "encryptionkey@0"
I20260806 15:07:54.697199 663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:54.721005 663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:54.723336 663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:54.723516 663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:54.728040 663 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:41463
I20260806 15:07:54.728097 731 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:41463 every 8 connection(s)
I20260806 15:07:54.728458 663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:54.729454 732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:54.731659 732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb: Bootstrap starting.
I20260806 15:07:54.732182 732 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:54.732419 732 log.cc:824] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:54.733078 732 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb: No bootstrap required, opened a new log
I20260806 15:07:54.733225 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 663
I20260806 15:07:54.733335 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:54.733503 29974 external_mini_cluster.cc:1428] Setting key aa6fed365e8f0b6c781e27db532c70a6
I20260806 15:07:54.735404 732 raft_consensus.cc:348] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc652e1e74040fa80463ede856df0bb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41463 } }
I20260806 15:07:54.735575 732 raft_consensus.cc:374] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:54.735618 732 raft_consensus.cc:729] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcc652e1e74040fa80463ede856df0bb, State: Initialized, Role: FOLLOWER
I20260806 15:07:54.735740 732 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc652e1e74040fa80463ede856df0bb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41463 } }
I20260806 15:07:54.735822 732 raft_consensus.cc:388] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:54.735845 732 raft_consensus.cc:482] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:54.735900 732 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:54.737049 732 raft_consensus.cc:504] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc652e1e74040fa80463ede856df0bb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41463 } }
I20260806 15:07:54.737159 732 leader_election.cc:302] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcc652e1e74040fa80463ede856df0bb; no voters:
I20260806 15:07:54.737304 732 leader_election.cc:288] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:54.737390 737 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:54.737543 737 raft_consensus.cc:686] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [term 1 LEADER]: Becoming Leader. State: Replica: fcc652e1e74040fa80463ede856df0bb, State: Running, Role: LEADER
I20260806 15:07:54.737568 732 sys_catalog.cc:564] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:54.737629 737 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc652e1e74040fa80463ede856df0bb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41463 } }
I20260806 15:07:54.737957 737 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcc652e1e74040fa80463ede856df0bb. Latest consensus state: current_term: 1 leader_uuid: "fcc652e1e74040fa80463ede856df0bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc652e1e74040fa80463ede856df0bb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41463 } } }
I20260806 15:07:54.738032 737 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:54.738400 738 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcc652e1e74040fa80463ede856df0bb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcc652e1e74040fa80463ede856df0bb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41463 } } }
I20260806 15:07:54.738484 738 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb [sys.catalog]: This master's current role is: LEADER
W20260806 15:07:54.739391 753 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:07:54.739465 753 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:07:54.739537 744 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:54.739722 744 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:54.741082 744 catalog_manager.cc:1347] Generated new cluster ID: 4b81027335fd460a82c57371c7e6d475
I20260806 15:07:54.741137 744 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:07:54 dist-test-slave-tm1g krb5kdc[648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028874, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:54.746299 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:54.734045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42424 (local address 127.29.69.190:41463)
0806 15:07:54.734258 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:54.734267 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:54.734325 (+ 58us) server_negotiation.cc:407] Connection header received
0806 15:07:54.735356 (+ 1031us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:54.735365 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:54.735429 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:54.735573 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:54.736347 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:54.737773 (+ 1426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:54.738954 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:54.739595 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:54.739700 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:54.742546 (+ 2846us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:54.742550 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:54.742550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:54.742562 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:54.744514 (+ 1952us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:54.744907 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:54.744910 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:54.744910 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:54.745056 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:54.745267 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:54.745268 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:54.745269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:54.745613 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:54.745783 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:54.745865 (+ 82us) server_negotiation.cc:299] Negotiation successful
0806 15:07:54.746046 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":101,"threads_started":1}
I20260806 15:07:54.752086 744 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:54.752755 744 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:54.760185 744 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fcc652e1e74040fa80463ede856df0bb: Generated new TSK 0
I20260806 15:07:54.760365 744 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:54.789203 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41463
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:54.869194 758 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:54.869395 758 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:54.869419 758 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:54.870594 758 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:54.870631 758 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:54.870657 758 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:54.872043 758 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.758
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:54.872263 758 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:54.872503 758 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:54.877471 765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:54.877516 768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:54.877472 766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:54.877823 758 server_base.cc:1034] running on GCE node
I20260806 15:07:54.878125 758 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:54.878405 758 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:54.879562 758 hybrid_clock.cc:648] HybridClock initialized: now 1786028874879544 us; error 30 us; skew 500 ppm
Aug 06 15:07:54 dist-test-slave-tm1g krb5kdc[648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028874, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:54.882094 758 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:54.882834 758 webserver.cc:460] Webserver started at http://127.29.69.129:35539/ using document root <none> and password file <none>
I20260806 15:07:54.883088 758 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:54.883162 758 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:54.883282 758 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:54.884277 758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "0e2ddeaf54c14468b22eeb5a4526c2c9"
format_stamp: "Formatted at 2026-08-06 15:07:54 on dist-test-slave-tm1g"
server_key: "0162bf8ab3a75675398cff40a5668401"
server_key_iv: "e67ffbecd11ea0297cd8ae436c8879b0"
server_key_version: "encryptionkey@0"
I20260806 15:07:54.884667 758 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "0e2ddeaf54c14468b22eeb5a4526c2c9"
format_stamp: "Formatted at 2026-08-06 15:07:54 on dist-test-slave-tm1g"
server_key: "0162bf8ab3a75675398cff40a5668401"
server_key_iv: "e67ffbecd11ea0297cd8ae436c8879b0"
server_key_version: "encryptionkey@0"
I20260806 15:07:54.885985 758 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:07:54.886781 776 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:54.886958 758 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:54.887068 758 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "0e2ddeaf54c14468b22eeb5a4526c2c9"
format_stamp: "Formatted at 2026-08-06 15:07:54 on dist-test-slave-tm1g"
server_key: "0162bf8ab3a75675398cff40a5668401"
server_key_iv: "e67ffbecd11ea0297cd8ae436c8879b0"
server_key_version: "encryptionkey@0"
I20260806 15:07:54.887141 758 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:54.899787 758 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:54.901997 758 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:54.902153 758 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:54.902427 758 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:54.902735 758 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:54.902789 758 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:54.902829 758 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:54.902856 758 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:54.908643 758 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:44535
I20260806 15:07:54.908694 893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:44535 every 8 connection(s)
I20260806 15:07:54.908983 758 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:54.913663 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 758
I20260806 15:07:54.913784 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:54.913962 29974 external_mini_cluster.cc:1428] Setting key 2b4895a0998d7c5f13a6d56a8f4cae2b
Aug 06 15:07:54 dist-test-slave-tm1g krb5kdc[648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028874, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:54.918671 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:54.909658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:34159 (local address 127.29.69.190:41463)
0806 15:07:54.909744 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:54.909747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:54.909917 (+ 170us) server_negotiation.cc:407] Connection header received
0806 15:07:54.910487 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:54.910488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:54.910506 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:54.910567 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:54.911568 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:54.912090 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:54.913107 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:54.913325 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:54.913404 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:54.915768 (+ 2364us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:54.915769 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:54.915769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:54.915777 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:54.917183 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:54.917672 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:54.917672 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:54.917673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:54.917722 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:54.918003 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:54.918004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:54.918004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:54.918101 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:54.918152 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:54.918526 (+ 374us) server_negotiation.cc:299] Negotiation successful
0806 15:07:54.918607 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 15:07:54.918933 896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:54.909605 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:41463 (local address 127.29.69.129:34159)
0806 15:07:54.909773 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:54.909811 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:54.910347 (+ 536us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:54.910644 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:54.910648 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:54.911251 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:54.911446 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:54.911451 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:54.912200 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:54.912201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:54.913011 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:54.913013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:54.913420 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:54.913421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:54.913544 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:54.914150 (+ 606us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:54.914159 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:54.915677 (+ 1518us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:54.917265 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:54.917272 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:54.917274 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:54.917596 (+ 322us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:54.917786 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:54.917787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:54.917787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:54.917939 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:54.918167 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:54.918174 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:54.918364 (+ 190us) client_negotiation.cc:769] Sending connection context
0806 15:07:54.918487 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 15:07:54.918671 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260806 15:07:54.919387 894 heartbeater.cc:347] Connected to a master server at 127.29.69.190:41463
I20260806 15:07:54.919480 894 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:54.919667 894 heartbeater.cc:511] Master 127.29.69.190:41463 requested a full tablet report, sending...
I20260806 15:07:54.920166 696 ts_manager.cc:194] Registered new tserver with Master: 0e2ddeaf54c14468b22eeb5a4526c2c9 (127.29.69.129:44535)
I20260806 15:07:54.920770 696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:34159
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:54.938356 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41463
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:55.018841 899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:55.019078 899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:55.019115 899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:55.020259 899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:55.020326 899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:55.020373 899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:55.021822 899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:55.022091 899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:55.022367 899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:55.027191 907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:55.027227 905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:55.027223 904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:55.027374 899 server_base.cc:1034] running on GCE node
I20260806 15:07:55.027559 899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:55.027747 899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:55.028915 899 hybrid_clock.cc:648] HybridClock initialized: now 1786028875028900 us; error 37 us; skew 500 ppm
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028875, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:55.031433 899 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:55.031857 899 webserver.cc:460] Webserver started at http://127.29.69.130:34565/ using document root <none> and password file <none>
I20260806 15:07:55.032094 899 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:55.032168 899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:55.032310 899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:55.033293 899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "934a91b568a94d5ca784a8fb0ede7208"
format_stamp: "Formatted at 2026-08-06 15:07:55 on dist-test-slave-tm1g"
server_key: "ddb76938b1b529ddf2000a6911591eb3"
server_key_iv: "f53b4710485b06aa6f2e6730f76c48dd"
server_key_version: "encryptionkey@0"
I20260806 15:07:55.033591 899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "934a91b568a94d5ca784a8fb0ede7208"
format_stamp: "Formatted at 2026-08-06 15:07:55 on dist-test-slave-tm1g"
server_key: "ddb76938b1b529ddf2000a6911591eb3"
server_key_iv: "f53b4710485b06aa6f2e6730f76c48dd"
server_key_version: "encryptionkey@0"
I20260806 15:07:55.034919 899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 15:07:55.035590 914 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:55.035785 899 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:55.035880 899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "934a91b568a94d5ca784a8fb0ede7208"
format_stamp: "Formatted at 2026-08-06 15:07:55 on dist-test-slave-tm1g"
server_key: "ddb76938b1b529ddf2000a6911591eb3"
server_key_iv: "f53b4710485b06aa6f2e6730f76c48dd"
server_key_version: "encryptionkey@0"
I20260806 15:07:55.035959 899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:55.050092 899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:55.052002 899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:55.052160 899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:55.052392 899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:55.052704 899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:55.052738 899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:55.052759 899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:55.052807 899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:55.058728 899 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:37805
I20260806 15:07:55.058776 1033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:37805 every 8 connection(s)
I20260806 15:07:55.059077 899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:55.062727 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 899
I20260806 15:07:55.062821 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:55.063002 29974 external_mini_cluster.cc:1428] Setting key f79d43129b9f03f7d82a20433b733499
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028875, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:55.068778 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:55.059747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:49185 (local address 127.29.69.190:41463)
0806 15:07:55.059789 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:55.059791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:55.059990 (+ 199us) server_negotiation.cc:407] Connection header received
0806 15:07:55.060547 (+ 557us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:55.060549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:55.060562 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:55.060619 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:55.061561 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.062084 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.063322 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.063528 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.063616 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:55.065830 (+ 2214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:55.065832 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:55.065832 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:55.065848 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:55.067366 (+ 1518us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:55.067781 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:55.067782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:55.067783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:55.067863 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:55.068118 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:55.068119 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:55.068119 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:55.068243 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:55.068322 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:55.068597 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 15:07:55.068684 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260806 15:07:55.068953 1036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:55.059715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:41463 (local address 127.29.69.130:49185)
0806 15:07:55.059855 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:55.059901 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:55.060435 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:55.060687 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:55.060691 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:55.061266 (+ 575us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:55.061458 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:55.061463 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.062184 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.062185 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:55.063231 (+ 1046us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:55.063234 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.063626 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.063627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:55.063763 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:55.064278 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:55.064287 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:55.065732 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:55.067456 (+ 1724us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:55.067463 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:55.067465 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:55.067693 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:55.067933 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:55.067934 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:55.067934 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:55.068047 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:55.068312 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:55.068319 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:55.068461 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 15:07:55.068564 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 15:07:55.068721 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":71,"threads_started":1}
I20260806 15:07:55.069386 1034 heartbeater.cc:347] Connected to a master server at 127.29.69.190:41463
I20260806 15:07:55.069476 1034 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:55.069672 1034 heartbeater.cc:511] Master 127.29.69.190:41463 requested a full tablet report, sending...
I20260806 15:07:55.070071 696 ts_manager.cc:194] Registered new tserver with Master: 934a91b568a94d5ca784a8fb0ede7208 (127.29.69.130:37805)
I20260806 15:07:55.070526 696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:49185
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:55.086998 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41463
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:55.167861 1039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:55.168097 1039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:55.168134 1039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:55.169260 1039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:55.169328 1039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:55.169373 1039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:55.170914 1039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:41463
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:55.171178 1039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:55.171404 1039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:55.176302 1045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:55.176286 1047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:55.176280 1044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:55.176560 1039 server_base.cc:1034] running on GCE node
I20260806 15:07:55.176783 1039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:55.177021 1039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:55.178184 1039 hybrid_clock.cc:648] HybridClock initialized: now 1786028875178167 us; error 31 us; skew 500 ppm
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028875, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:55.180817 1039 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:55.181293 1039 webserver.cc:460] Webserver started at http://127.29.69.131:33241/ using document root <none> and password file <none>
I20260806 15:07:55.181552 1039 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:55.181622 1039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:55.181769 1039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:55.182853 1039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "e582569f366b447ba9b6081edf684896"
format_stamp: "Formatted at 2026-08-06 15:07:55 on dist-test-slave-tm1g"
server_key: "dd0e2c15eec0b3efbe8b860645af3a6d"
server_key_iv: "535dcd4c6aebf31551a66891001df56d"
server_key_version: "encryptionkey@0"
I20260806 15:07:55.183216 1039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "e582569f366b447ba9b6081edf684896"
format_stamp: "Formatted at 2026-08-06 15:07:55 on dist-test-slave-tm1g"
server_key: "dd0e2c15eec0b3efbe8b860645af3a6d"
server_key_iv: "535dcd4c6aebf31551a66891001df56d"
server_key_version: "encryptionkey@0"
I20260806 15:07:55.184561 1039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 15:07:55.185302 1055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:55.185534 1039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:55.185645 1039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "e582569f366b447ba9b6081edf684896"
format_stamp: "Formatted at 2026-08-06 15:07:55 on dist-test-slave-tm1g"
server_key: "dd0e2c15eec0b3efbe8b860645af3a6d"
server_key_iv: "535dcd4c6aebf31551a66891001df56d"
server_key_version: "encryptionkey@0"
I20260806 15:07:55.185725 1039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:55.205236 1039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:55.207535 1039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:55.207695 1039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:55.207923 1039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:55.208230 1039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:55.208288 1039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:55.208328 1039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:55.208355 1039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:55.213955 1039 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:34639
I20260806 15:07:55.214051 1174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:34639 every 8 connection(s)
I20260806 15:07:55.214346 1039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028875, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:55.221611 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1039
I20260806 15:07:55.221732 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:55.221906 29974 external_mini_cluster.cc:1428] Setting key f724063fc4ea99c594a1ac2c6f851047
I20260806 15:07:55.223647 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:55.215029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:34677 (local address 127.29.69.190:41463)
0806 15:07:55.215073 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:55.215075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:55.215447 (+ 372us) server_negotiation.cc:407] Connection header received
0806 15:07:55.215977 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:55.215978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:55.215991 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:55.216045 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:55.216962 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.217473 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.218529 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.218728 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.218828 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:55.220886 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:55.220888 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:55.220888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:55.220895 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:55.222283 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:55.222707 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:55.222708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:55.222709 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:55.222771 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:55.223013 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:55.223014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:55.223014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:55.223134 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:55.223211 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:55.223476 (+ 265us) server_negotiation.cc:299] Negotiation successful
0806 15:07:55.223555 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:55.223834 1178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:55.215005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:41463 (local address 127.29.69.131:34677)
0806 15:07:55.215171 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:55.215213 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:55.215870 (+ 657us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:55.216110 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:55.216114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:55.216680 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:55.216862 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:55.216866 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.217566 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.217567 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:55.218443 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:55.218446 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.218836 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.218837 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:55.218970 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:55.219423 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:55.219430 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:55.220786 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:55.222402 (+ 1616us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:55.222408 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:55.222410 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:55.222627 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:55.222835 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:55.222836 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:55.222836 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:55.222943 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:55.223199 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:55.223206 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:55.223339 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 15:07:55.223454 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 15:07:55.223608 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260806 15:07:55.224293 1175 heartbeater.cc:347] Connected to a master server at 127.29.69.190:41463
I20260806 15:07:55.224375 1175 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:55.224535 1175 heartbeater.cc:511] Master 127.29.69.190:41463 requested a full tablet report, sending...
I20260806 15:07:55.224889 696 ts_manager.cc:194] Registered new tserver with Master: e582569f366b447ba9b6081edf684896 (127.29.69.131:34639)
I20260806 15:07:55.225253 696 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:34677
I20260806 15:07:55.233598 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[648](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028875, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[648](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028875, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:55.257550 736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:55.249276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42436 (local address 127.29.69.190:41463)
0806 15:07:55.249373 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:55.249374 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:55.249456 (+ 82us) server_negotiation.cc:407] Connection header received
0806 15:07:55.249562 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:55.249563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:55.249573 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:55.249642 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:55.250195 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.250758 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.251495 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:55.251703 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:55.251776 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:55.254153 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:55.254155 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:55.254155 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:55.254164 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:55.256003 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:55.256491 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:55.256493 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:55.256493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:55.256566 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:55.256810 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:55.256810 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:55.256811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:55.257042 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:55.257173 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:55.257322 (+ 149us) server_negotiation.cc:299] Negotiation successful
0806 15:07:55.257417 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260806 15:07:55.258553 696 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42436
I20260806 15:07:55.259092 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 758
I20260806 15:07:55.267122 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 899
I20260806 15:07:55.274101 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1039
I20260806 15:07:55.279299 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 663
2026-08-06T15:07:55Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1837 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[1188](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[1188](info): set up 2 sockets
Aug 06 15:07:55 dist-test-slave-tm1g krb5kdc[1188](info): commencing operation
krb5kdc: starting...
W20260806 15:07:56.330535 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:56.441195 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46805
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46805
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:56.520669 1201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:56.520908 1201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:56.520946 1201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:56.522106 1201 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:56.522176 1201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:56.522202 1201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:56.522230 1201 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:56.522262 1201 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:56.523788 1201 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46805
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46805
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:56.524062 1201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:56.524288 1201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:56.529107 1207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:56.529112 1209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:56.529125 1206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:56.529361 1201 server_base.cc:1034] running on GCE node
I20260806 15:07:56.529590 1201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:56.529870 1201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:56.531006 1201 hybrid_clock.cc:648] HybridClock initialized: now 1786028876530986 us; error 34 us; skew 500 ppm
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:56.533452 1201 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:56.533845 1201 webserver.cc:460] Webserver started at http://127.29.69.190:37703/ using document root <none> and password file <none>
I20260806 15:07:56.534024 1201 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:56.534063 1201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:56.534150 1201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:56.535211 1201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "ef476d8d55a11938f466d1dc0fb01e74"
server_key_iv: "6bc54b9b4c806436873839eb5cfab88d"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.535511 1201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "ef476d8d55a11938f466d1dc0fb01e74"
server_key_iv: "6bc54b9b4c806436873839eb5cfab88d"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.536711 1201 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:56.537352 1216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.537528 1201 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:56.537613 1201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "ef476d8d55a11938f466d1dc0fb01e74"
server_key_iv: "6bc54b9b4c806436873839eb5cfab88d"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.537665 1201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:56.554672 1201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:56.556401 1201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:56.556506 1201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:56.560267 1201 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:46805
I20260806 15:07:56.560550 1270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:46805 every 8 connection(s)
I20260806 15:07:56.560623 1201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:56.561308 1271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:56.563563 1271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3: Bootstrap starting.
I20260806 15:07:56.564155 1271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:56.564450 1271 log.cc:824] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:56.565126 1271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3: No bootstrap required, opened a new log
I20260806 15:07:56.565256 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1201
I20260806 15:07:56.565378 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:56.565567 29974 external_mini_cluster.cc:1428] Setting key c56d47a77f8b3312de4cfbf6259a345e
I20260806 15:07:56.567495 1271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46805 } }
I20260806 15:07:56.567646 1271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:56.567711 1271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b6aa4b1a49f40c9a3fbc11a88a68dc3, State: Initialized, Role: FOLLOWER
I20260806 15:07:56.567847 1271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46805 } }
I20260806 15:07:56.567943 1271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:56.567993 1271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:56.568045 1271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:56.568565 1271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46805 } }
I20260806 15:07:56.568691 1271 leader_election.cc:302] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9b6aa4b1a49f40c9a3fbc11a88a68dc3; no voters:
I20260806 15:07:56.568898 1271 leader_election.cc:288] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:56.568936 1276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:56.569053 1276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [term 1 LEADER]: Becoming Leader. State: Replica: 9b6aa4b1a49f40c9a3fbc11a88a68dc3, State: Running, Role: LEADER
I20260806 15:07:56.569162 1271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:56.569290 1276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46805 } }
I20260806 15:07:56.570252 1278 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46805 } } }
I20260806 15:07:56.570386 1278 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:56.570593 1291 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:56.570708 1279 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9b6aa4b1a49f40c9a3fbc11a88a68dc3. Latest consensus state: current_term: 1 leader_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9b6aa4b1a49f40c9a3fbc11a88a68dc3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46805 } } }
I20260806 15:07:56.570783 1279 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:56.571153 1291 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:56.573041 1291 catalog_manager.cc:1347] Generated new cluster ID: d1d34190021f4fb9962c8ca554660f5d
I20260806 15:07:56.573223 1291 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:56.577795 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:56.566028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50298 (local address 127.29.69.190:46805)
0806 15:07:56.566201 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:56.566211 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:56.566247 (+ 36us) server_negotiation.cc:407] Connection header received
0806 15:07:56.567477 (+ 1230us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:56.567483 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:56.567527 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:56.567659 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:56.568400 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.569655 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.570864 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.571427 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.571541 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:56.574360 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:56.574364 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:56.574364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:56.574376 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:56.576260 (+ 1884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:56.576615 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:56.576617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:56.576618 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:56.576731 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:56.576942 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:56.576943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:56.576944 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:56.577177 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:56.577341 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:56.577449 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 15:07:56.577598 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260806 15:07:56.589174 1291 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:56.589669 1291 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:56.595578 1291 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9b6aa4b1a49f40c9a3fbc11a88a68dc3: Generated new TSK 0
I20260806 15:07:56.595755 1291 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:56.625252 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46805
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:56.705720 1299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:56.705912 1299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:56.705935 1299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:56.707113 1299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:56.707154 1299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:56.707204 1299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:56.708690 1299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1299
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:56.708933 1299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:56.709173 1299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:56.714008 1306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:56.714059 1308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:56.714190 1299 server_base.cc:1034] running on GCE node
W20260806 15:07:56.714008 1305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:56.714522 1299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:56.714792 1299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:56.715951 1299 hybrid_clock.cc:648] HybridClock initialized: now 1786028876715933 us; error 35 us; skew 500 ppm
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:56.718437 1299 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:56.718839 1299 webserver.cc:460] Webserver started at http://127.29.69.129:46269/ using document root <none> and password file <none>
I20260806 15:07:56.719079 1299 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:56.719147 1299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:56.719298 1299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:56.720348 1299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "a2dbf38726484d9da0b79cc93fbf64db"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "df64afc5e09ca51424cbae8574eeed0e"
server_key_iv: "04d64d39b8e2b3ba967ee28ae0d9b9df"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.720695 1299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "a2dbf38726484d9da0b79cc93fbf64db"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "df64afc5e09ca51424cbae8574eeed0e"
server_key_iv: "04d64d39b8e2b3ba967ee28ae0d9b9df"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.721972 1299 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:56.722728 1317 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.722891 1299 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.723002 1299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "a2dbf38726484d9da0b79cc93fbf64db"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "df64afc5e09ca51424cbae8574eeed0e"
server_key_iv: "04d64d39b8e2b3ba967ee28ae0d9b9df"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.723073 1299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:56.753046 1299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:56.755395 1299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:56.755563 1299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:56.755798 1299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:56.756116 1299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:56.756170 1299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.756204 1299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:56.756233 1299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.761785 1299 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:40681
I20260806 15:07:56.761881 1433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:40681 every 8 connection(s)
I20260806 15:07:56.762174 1299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:56.770504 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1299
I20260806 15:07:56.770584 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:56.770798 29974 external_mini_cluster.cc:1428] Setting key f54e85efcab68f3e0ee184af5ec4c724
I20260806 15:07:56.771675 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:56.762939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:40075 (local address 127.29.69.190:46805)
0806 15:07:56.762986 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:56.762988 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:56.763207 (+ 219us) server_negotiation.cc:407] Connection header received
0806 15:07:56.764168 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:56.764170 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:56.764186 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:56.764240 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:56.764847 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.765368 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.766403 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.766629 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.766715 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:56.768682 (+ 1967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:56.768684 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:56.768684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:56.768693 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:56.770004 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:56.770485 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:56.770486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:56.770487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:56.770544 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:56.770946 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:56.770947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:56.770947 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:56.771099 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:56.771167 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:56.771500 (+ 333us) server_negotiation.cc:299] Negotiation successful
0806 15:07:56.771602 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:07:56.771938 1436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:56.762898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46805 (local address 127.29.69.129:40075)
0806 15:07:56.763085 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:56.763119 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:56.764048 (+ 929us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:56.764307 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:56.764311 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:56.764566 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:56.764748 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:56.764752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.765464 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.765465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:56.766288 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:56.766290 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.766738 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.766739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:56.766875 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:56.767295 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:56.767302 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:56.768581 (+ 1279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:56.770084 (+ 1503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:56.770092 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:56.770094 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:56.770400 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:56.770671 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:56.770672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:56.770672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:56.770877 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:56.771195 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:56.771203 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:56.771345 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 15:07:56.771474 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 15:07:56.771667 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":84,"threads_started":1}
I20260806 15:07:56.772476 1434 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46805
I20260806 15:07:56.772585 1434 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:56.772758 1434 heartbeater.cc:511] Master 127.29.69.190:46805 requested a full tablet report, sending...
I20260806 15:07:56.773335 1233 ts_manager.cc:194] Registered new tserver with Master: a2dbf38726484d9da0b79cc93fbf64db (127.29.69.129:40681)
I20260806 15:07:56.774240 1233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:40075
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:56.796702 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46805
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:56.876506 1439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:56.876734 1439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:56.876773 1439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:56.877910 1439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:56.877977 1439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:56.878026 1439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:56.879534 1439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:56.879786 1439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:56.880008 1439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:56.884934 1446 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:56.884943 1450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:56.884944 1445 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:56.885174 1439 server_base.cc:1034] running on GCE node
I20260806 15:07:56.885447 1439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:56.885658 1439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:56.886821 1439 hybrid_clock.cc:648] HybridClock initialized: now 1786028876886810 us; error 37 us; skew 500 ppm
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:56.889168 1439 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:56.889647 1439 webserver.cc:460] Webserver started at http://127.29.69.130:40575/ using document root <none> and password file <none>
I20260806 15:07:56.889866 1439 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:56.889938 1439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:56.890087 1439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:56.891211 1439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "48ac34c004f94eaebd563564278d9b82"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "fa1874ec7d8fb70dc2c99c3831b6008b"
server_key_iv: "6f6a61ae6c9c8051e73965cb263699ed"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.891577 1439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "48ac34c004f94eaebd563564278d9b82"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "fa1874ec7d8fb70dc2c99c3831b6008b"
server_key_iv: "6f6a61ae6c9c8051e73965cb263699ed"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.892911 1439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:07:56.893620 1457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.893795 1439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:56.893894 1439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "48ac34c004f94eaebd563564278d9b82"
format_stamp: "Formatted at 2026-08-06 15:07:56 on dist-test-slave-tm1g"
server_key: "fa1874ec7d8fb70dc2c99c3831b6008b"
server_key_iv: "6f6a61ae6c9c8051e73965cb263699ed"
server_key_version: "encryptionkey@0"
I20260806 15:07:56.893978 1439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:56.922997 1439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:56.924973 1439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:56.925140 1439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:56.925390 1439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:56.925791 1439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:56.925848 1439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.925884 1439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:56.925913 1439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:56.932348 1439 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:46213
I20260806 15:07:56.932389 1574 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:46213 every 8 connection(s)
I20260806 15:07:56.932750 1439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
Aug 06 15:07:56 dist-test-slave-tm1g krb5kdc[1188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028876, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:56.941351 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1439
I20260806 15:07:56.941466 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:56.941668 29974 external_mini_cluster.cc:1428] Setting key d0325ec657a59d27e8e3b6121b9c2aa1
I20260806 15:07:56.942344 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:56.933510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:56579 (local address 127.29.69.190:46805)
0806 15:07:56.933556 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:56.933558 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:56.933782 (+ 224us) server_negotiation.cc:407] Connection header received
0806 15:07:56.934867 (+ 1085us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:56.934869 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:56.934881 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:56.934935 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:56.935571 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.936085 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.937079 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.937276 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.937369 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:56.939466 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:56.939468 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:56.939469 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:56.939476 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:56.940731 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:56.941140 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:56.941141 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:56.941142 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:56.941204 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:56.941487 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:56.941489 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:56.941489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:56.941653 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:56.941733 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:56.942127 (+ 394us) server_negotiation.cc:299] Negotiation successful
0806 15:07:56.942213 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:56.942520 1577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:56.933486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46805 (local address 127.29.69.130:56579)
0806 15:07:56.933664 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:56.933700 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:56.934754 (+ 1054us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:56.935010 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:56.935014 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:56.935279 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:56.935471 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:56.935475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.936182 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.936183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:56.936977 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:56.936979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:56.937394 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:56.937395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:56.937523 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:56.938005 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:56.938013 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:56.939369 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:56.940819 (+ 1450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:56.940825 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:56.940827 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:56.941065 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:56.941271 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:56.941272 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:56.941272 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:56.941376 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:56.941768 (+ 392us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:56.941777 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:56.941965 (+ 188us) client_negotiation.cc:769] Sending connection context
0806 15:07:56.942084 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 15:07:56.942214 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":85,"threads_started":1}
I20260806 15:07:56.943064 1575 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46805
I20260806 15:07:56.943167 1575 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:56.943359 1575 heartbeater.cc:511] Master 127.29.69.190:46805 requested a full tablet report, sending...
I20260806 15:07:56.943681 1233 ts_manager.cc:194] Registered new tserver with Master: 48ac34c004f94eaebd563564278d9b82 (127.29.69.130:46213)
I20260806 15:07:56.944059 1233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:56579
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:56.965360 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46805
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:44035
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:57.045899 1581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:57.046089 1581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:57.046113 1581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:57.047250 1581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:57.047291 1581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:57.047318 1581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:57.048712 1581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44035
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46805
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1581
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:57.048884 1581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:57.049057 1581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:57.053854 1589 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:57.053830 1587 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:57.053869 1581 server_base.cc:1034] running on GCE node
W20260806 15:07:57.053833 1586 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:57.054419 1581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:57.054613 1581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:57.055749 1581 hybrid_clock.cc:648] HybridClock initialized: now 1786028877055736 us; error 28 us; skew 500 ppm
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028877, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:57.058259 1581 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:57.058732 1581 webserver.cc:460] Webserver started at http://127.29.69.131:38407/ using document root <none> and password file <none>
I20260806 15:07:57.059023 1581 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:57.059103 1581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:57.059235 1581 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:57.060230 1581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "7cf12f7d366e4177a5e421ad471f1600"
format_stamp: "Formatted at 2026-08-06 15:07:57 on dist-test-slave-tm1g"
server_key: "53d3ebb18f79f01674c808836894d2c2"
server_key_iv: "ec729c67b1a4249df6d60f4e62d221dc"
server_key_version: "encryptionkey@0"
I20260806 15:07:57.060582 1581 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "7cf12f7d366e4177a5e421ad471f1600"
format_stamp: "Formatted at 2026-08-06 15:07:57 on dist-test-slave-tm1g"
server_key: "53d3ebb18f79f01674c808836894d2c2"
server_key_iv: "ec729c67b1a4249df6d60f4e62d221dc"
server_key_version: "encryptionkey@0"
I20260806 15:07:57.061864 1581 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:07:57.062649 1597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:57.062819 1581 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:57.062916 1581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "7cf12f7d366e4177a5e421ad471f1600"
format_stamp: "Formatted at 2026-08-06 15:07:57 on dist-test-slave-tm1g"
server_key: "53d3ebb18f79f01674c808836894d2c2"
server_key_iv: "ec729c67b1a4249df6d60f4e62d221dc"
server_key_version: "encryptionkey@0"
I20260806 15:07:57.062996 1581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:57.077829 1581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:57.079629 1581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:57.079733 1581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:57.079892 1581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:57.080122 1581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:57.080152 1581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:57.080173 1581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:57.080185 1581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:57.085932 1581 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36203
I20260806 15:07:57.085979 1714 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36203 every 8 connection(s)
I20260806 15:07:57.086265 1581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:07:57.089890 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1581
I20260806 15:07:57.089990 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:57.090154 29974 external_mini_cluster.cc:1428] Setting key 79f9c19ba553da3c5ee222a942bef8e8
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028877, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:57.095438 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:57.087070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:53687 (local address 127.29.69.190:46805)
0806 15:07:57.087137 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:57.087140 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:57.087351 (+ 211us) server_negotiation.cc:407] Connection header received
0806 15:07:57.088229 (+ 878us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:57.088231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:57.088241 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:57.088291 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:57.088833 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.089324 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.090710 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.091013 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.091078 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:57.093098 (+ 2020us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:57.093099 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:57.093099 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:57.093104 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:57.094274 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:57.094675 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:57.094676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:57.094677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:57.094728 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:57.094931 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:57.094931 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:57.094932 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:57.095026 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:57.095077 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:57.095291 (+ 214us) server_negotiation.cc:299] Negotiation successful
0806 15:07:57.095370 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:07:57.095710 1717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:57.087041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46805 (local address 127.29.69.131:53687)
0806 15:07:57.087237 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:57.087271 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:57.088146 (+ 875us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:57.088340 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:57.088343 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:57.088590 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:57.088767 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:57.088770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.089411 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.089412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:57.090599 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:57.090602 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.091098 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.091099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:57.091212 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:57.091709 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:57.091722 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:57.093025 (+ 1303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:57.094393 (+ 1368us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:57.094399 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:57.094401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:57.094614 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:57.094785 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:57.094786 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:57.094786 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:57.094878 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:57.095079 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:57.095083 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:57.095185 (+ 102us) client_negotiation.cc:769] Sending connection context
0806 15:07:57.095264 (+ 79us) client_negotiation.cc:240] Negotiation successful
0806 15:07:57.095419 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":113,"threads_started":1}
I20260806 15:07:57.096226 1715 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46805
I20260806 15:07:57.096304 1715 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:57.096438 1715 heartbeater.cc:511] Master 127.29.69.190:46805 requested a full tablet report, sending...
I20260806 15:07:57.096839 1233 ts_manager.cc:194] Registered new tserver with Master: 7cf12f7d366e4177a5e421ad471f1600 (127.29.69.131:36203)
I20260806 15:07:57.097167 1233 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:53687
I20260806 15:07:57.101768 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1188](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:07:57.123485 1722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:57.116434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44564 (local address 127.29.69.129:40681)
0806 15:07:57.116588 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:57.116594 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:57.116612 (+ 18us) server_negotiation.cc:407] Connection header received
0806 15:07:57.116636 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:57.116638 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:57.116653 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:57.116718 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:57.117237 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.117939 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.118672 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.118989 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.119045 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:57.121098 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:57.121105 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:57.121105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:57.121111 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:57.122544 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:57.122846 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:57.122849 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:57.122849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:57.122907 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:57.123073 (+ 166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:57.123073 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:57.123074 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:57.123192 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:57.123290 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:57.123351 (+ 61us) server_negotiation.cc:299] Negotiation successful
0806 15:07:57.123410 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":86,"threads_started":1}
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1188](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028877, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:57.131048 1275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:57.124760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50300 (local address 127.29.69.190:46805)
0806 15:07:57.124827 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:57.124829 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:57.124836 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:07:57.124857 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:57.124858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:57.124865 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:57.124910 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:57.125388 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.125886 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.126604 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:57.126783 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:57.126836 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:57.128762 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:57.128763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:57.128764 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:57.128770 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:57.130101 (+ 1331us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:57.130464 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:57.130465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:57.130465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:57.130513 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:57.130663 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:57.130663 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:57.130664 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:57.130784 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:57.130849 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:57.130929 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 15:07:57.130987 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260806 15:07:57.131301 1233 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:50300
I20260806 15:07:57.131675 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1299
I20260806 15:07:57.137816 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1439
I20260806 15:07:57.143117 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1581
I20260806 15:07:57.148104 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1201
2026-08-06T15:07:57Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1868 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1729](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1729](info): set up 2 sockets
Aug 06 15:07:57 dist-test-slave-tm1g krb5kdc[1729](info): commencing operation
krb5kdc: starting...
W20260806 15:07:58.198659 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:07:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:07:58.316617 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42989
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:42989
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:58.396626 1743 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:58.396863 1743 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:58.396903 1743 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:58.398072 1743 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:58.398142 1743 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:58.398167 1743 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:58.398191 1743 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:58.398218 1743 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:58.399731 1743 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:42989
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42989
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:58.400004 1743 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:58.400230 1743 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:58.404917 1748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:58.405143 1743 server_base.cc:1034] running on GCE node
W20260806 15:07:58.406021 1749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:58.406126 1751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:58.406448 1743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:58.406718 1743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:58.407868 1743 hybrid_clock.cc:648] HybridClock initialized: now 1786028878407854 us; error 33 us; skew 500 ppm
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:58.413677 1743 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:07:58.414029 1743 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:58.414103 1743 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:58.414255 1743 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:58.415329 1743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "ec0fb18de708484da5c21af0a6428668"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "e9c216088fd077a9c9aab09ca2136b12"
server_key_iv: "9cb36e418747b464b2118b662cc9e30d"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.415694 1743 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "ec0fb18de708484da5c21af0a6428668"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "e9c216088fd077a9c9aab09ca2136b12"
server_key_iv: "9cb36e418747b464b2118b662cc9e30d"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.416996 1743 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:07:58.417693 1758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.417861 1743 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:58.417976 1743 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "ec0fb18de708484da5c21af0a6428668"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "e9c216088fd077a9c9aab09ca2136b12"
server_key_iv: "9cb36e418747b464b2118b662cc9e30d"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.418049 1743 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:58.441727 1743 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:58.443691 1743 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:58.443859 1743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:58.447896 1743 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:42989
I20260806 15:07:58.447978 1810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:42989 every 8 connection(s)
I20260806 15:07:58.448263 1743 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:58.449316 1811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:58.451167 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1743
I20260806 15:07:58.451313 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:58.451499 29974 external_mini_cluster.cc:1428] Setting key c3e83c22a5fa5d83e3809ab688394138
I20260806 15:07:58.451989 1811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668: Bootstrap starting.
I20260806 15:07:58.452752 1811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:58.453107 1811 log.cc:824] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:58.453820 1811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668: No bootstrap required, opened a new log
I20260806 15:07:58.456054 1811 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec0fb18de708484da5c21af0a6428668" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42989 } }
I20260806 15:07:58.456218 1811 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:58.456250 1811 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec0fb18de708484da5c21af0a6428668, State: Initialized, Role: FOLLOWER
I20260806 15:07:58.456367 1811 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec0fb18de708484da5c21af0a6428668" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42989 } }
I20260806 15:07:58.456437 1811 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:58.456467 1811 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:58.456514 1811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:58.457212 1811 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec0fb18de708484da5c21af0a6428668" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42989 } }
I20260806 15:07:58.457350 1811 leader_election.cc:302] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec0fb18de708484da5c21af0a6428668; no voters:
I20260806 15:07:58.457509 1811 leader_election.cc:288] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:58.457551 1816 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:58.457695 1816 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [term 1 LEADER]: Becoming Leader. State: Replica: ec0fb18de708484da5c21af0a6428668, State: Running, Role: LEADER
I20260806 15:07:58.457772 1811 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:58.457850 1816 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec0fb18de708484da5c21af0a6428668" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42989 } }
I20260806 15:07:58.458184 1818 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec0fb18de708484da5c21af0a6428668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec0fb18de708484da5c21af0a6428668" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42989 } } }
I20260806 15:07:58.458281 1818 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:58.458174 1816 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec0fb18de708484da5c21af0a6428668. Latest consensus state: current_term: 1 leader_uuid: "ec0fb18de708484da5c21af0a6428668" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec0fb18de708484da5c21af0a6428668" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42989 } } }
I20260806 15:07:58.458909 1816 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668 [sys.catalog]: This master's current role is: LEADER
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:58.459093 1824 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:58.459614 1824 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:58.461311 1824 catalog_manager.cc:1347] Generated new cluster ID: 3cc2bd47958947d9844d666cfa16aace
I20260806 15:07:58.461364 1824 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:07:58.463222 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.452063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59220 (local address 127.29.69.190:42989)
0806 15:07:58.452260 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.452269 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.452305 (+ 36us) server_negotiation.cc:407] Connection header received
0806 15:07:58.452961 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.452971 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.453036 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.453182 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:58.453862 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.455245 (+ 1383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.456012 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.456623 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.456737 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.459616 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:58.459619 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:58.459620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:58.459631 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:58.461608 (+ 1977us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.462000 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.462003 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.462003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.462102 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.462334 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.462334 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.462334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.462619 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:58.462761 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.462887 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.463023 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":94,"threads_started":1}
I20260806 15:07:58.469225 1824 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:58.469801 1824 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:58.472219 1824 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668: Generated new TSK 0
I20260806 15:07:58.472383 1824 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:07:58.503185 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42989
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:58.600855 1837 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:58.601058 1837 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:58.601082 1837 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:58.602222 1837 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:58.602264 1837 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:58.602291 1837 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:58.603835 1837 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1837
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:58.604086 1837 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:58.604312 1837 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:58.610062 1843 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:58.610061 1845 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:58.610096 1842 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:58.610390 1837 server_base.cc:1034] running on GCE node
I20260806 15:07:58.610589 1837 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:58.610781 1837 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:58.611970 1837 hybrid_clock.cc:648] HybridClock initialized: now 1786028878611962 us; error 32 us; skew 500 ppm
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:58.614388 1837 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:07:58.614725 1837 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:58.614801 1837 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:58.614954 1837 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:58.615993 1837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "4ff3539a35e746abaaa957b744845ed7"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "c51149a5d2df6419a60765b0b37b7a05"
server_key_iv: "60d8cac34bd7b08d869476b269c45aff"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.616357 1837 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "4ff3539a35e746abaaa957b744845ed7"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "c51149a5d2df6419a60765b0b37b7a05"
server_key_iv: "60d8cac34bd7b08d869476b269c45aff"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.617673 1837 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:58.618439 1852 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.618610 1837 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:07:58.618714 1837 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "4ff3539a35e746abaaa957b744845ed7"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "c51149a5d2df6419a60765b0b37b7a05"
server_key_iv: "60d8cac34bd7b08d869476b269c45aff"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.618798 1837 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:58.635908 1837 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:58.637741 1837 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:58.637908 1837 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:58.638154 1837 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:58.638531 1837 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:58.638585 1837 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.638619 1837 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:58.638648 1837 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.644775 1837 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:42301
I20260806 15:07:58.644814 1970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:42301 every 8 connection(s)
I20260806 15:07:58.645092 1837 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:58.648658 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1837
I20260806 15:07:58.648774 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:58.648967 29974 external_mini_cluster.cc:1428] Setting key ef3b638ff8f54e338c2d4f9a9951502f
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:58.655331 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.645826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:39893 (local address 127.29.69.190:42989)
0806 15:07:58.645895 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.645897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.646118 (+ 221us) server_negotiation.cc:407] Connection header received
0806 15:07:58.646721 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.646722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.646734 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.646797 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:58.647808 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.648343 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.649648 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.649980 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.650058 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.652475 (+ 2417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:58.652476 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:58.652477 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:58.652485 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:58.653888 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.654323 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.654324 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.654324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.654392 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.654668 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.654669 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.654669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.654788 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:58.654863 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.655138 (+ 275us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.655240 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:07:58.655483 1973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.645816 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42989 (local address 127.29.69.129:39893)
0806 15:07:58.645999 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:58.646034 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:58.646615 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:58.646870 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:58.646873 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:58.647119 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:58.647699 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.647705 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.648447 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.648449 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.649575 (+ 1126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.649577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.650068 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.650069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.650170 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.650733 (+ 563us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:58.650742 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:58.652372 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:58.653978 (+ 1606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:58.653986 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:58.653988 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:58.654222 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:58.654477 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:58.654478 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:58.654478 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:58.654593 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:58.654853 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:58.654860 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:58.655002 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 15:07:58.655105 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 15:07:58.655258 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":96,"threads_started":1}
I20260806 15:07:58.655972 1971 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42989
I20260806 15:07:58.656064 1971 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:58.656225 1971 heartbeater.cc:511] Master 127.29.69.190:42989 requested a full tablet report, sending...
I20260806 15:07:58.656759 1775 ts_manager.cc:194] Registered new tserver with Master: 4ff3539a35e746abaaa957b744845ed7 (127.29.69.129:42301)
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
I20260806 15:07:58.657358 1775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:39893
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:07:58.675165 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42989
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:58.757148 1976 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:58.757381 1976 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:58.757426 1976 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:58.758764 1976 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:58.758826 1976 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:58.758872 1976 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:58.760411 1976 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1976
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:58.760674 1976 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:58.760901 1976 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:58.765699 1981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:58.765918 1976 server_base.cc:1034] running on GCE node
W20260806 15:07:58.765707 1982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:58.765763 1984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:58.766216 1976 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:58.766506 1976 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:58.767676 1976 hybrid_clock.cc:648] HybridClock initialized: now 1786028878767654 us; error 34 us; skew 500 ppm
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:58.770161 1976 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:07:58.770568 1976 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:58.770643 1976 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:58.770792 1976 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:58.771812 1976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "ac115d34ff0d47f5916a03960fb909ec"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "6d7cd46e5be129a6e013b1e72a563c21"
server_key_iv: "6eb0ae5bde5771c0ad92df15ffd5fc16"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.772168 1976 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "ac115d34ff0d47f5916a03960fb909ec"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "6d7cd46e5be129a6e013b1e72a563c21"
server_key_iv: "6eb0ae5bde5771c0ad92df15ffd5fc16"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.773432 1976 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:07:58.774159 1990 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.774375 1976 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.774495 1976 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "ac115d34ff0d47f5916a03960fb909ec"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "6d7cd46e5be129a6e013b1e72a563c21"
server_key_iv: "6eb0ae5bde5771c0ad92df15ffd5fc16"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.774570 1976 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:58.787145 1976 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:58.788823 1976 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:58.788986 1976 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:58.789207 1976 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:58.789529 1976 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:58.789584 1976 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.789625 1976 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:58.789654 1976 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.795485 1976 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:38759
I20260806 15:07:58.795598 2107 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:38759 every 8 connection(s)
I20260806 15:07:58.795845 1976 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:58.799669 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 1976
I20260806 15:07:58.799764 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:58.799959 29974 external_mini_cluster.cc:1428] Setting key 4756fe4471cb038cca399bcd007c160b
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:58.805773 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.796654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:43975 (local address 127.29.69.190:42989)
0806 15:07:58.796702 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.796704 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.796904 (+ 200us) server_negotiation.cc:407] Connection header received
0806 15:07:58.797442 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.797443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.797455 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.797520 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:58.798461 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.798984 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.800164 (+ 1180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.800397 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.800474 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.802762 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:58.802763 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:58.802763 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:58.802770 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:58.804211 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.804695 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.804695 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.804696 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.804746 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.805037 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.805038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.805038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.805137 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:58.805186 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.805542 (+ 356us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.805663 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:07:58.806005 2110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.796655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42989 (local address 127.29.69.130:43975)
0806 15:07:58.796800 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:58.796834 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:58.797303 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:58.797593 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:58.797596 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:58.797847 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:58.798361 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.798367 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.799069 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.799069 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.800048 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.800051 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.800482 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.800483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.800634 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.801133 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:58.801141 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:58.802650 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:58.804290 (+ 1640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:58.804298 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:58.804300 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:58.804612 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:58.804810 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:58.804811 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:58.804811 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:58.804965 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:58.805203 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:58.805210 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:58.805393 (+ 183us) client_negotiation.cc:769] Sending connection context
0806 15:07:58.805523 (+ 130us) client_negotiation.cc:240] Negotiation successful
0806 15:07:58.805710 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
I20260806 15:07:58.806553 2108 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42989
I20260806 15:07:58.806648 2108 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:58.806811 2108 heartbeater.cc:511] Master 127.29.69.190:42989 requested a full tablet report, sending...
I20260806 15:07:58.807196 1775 ts_manager.cc:194] Registered new tserver with Master: ac115d34ff0d47f5916a03960fb909ec (127.29.69.130:38759)
I20260806 15:07:58.807585 1775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:43975
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:07:58.825295 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42989
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:34725
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:07:58.906456 2113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:58.906651 2113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:58.906674 2113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:58.907753 2113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:58.907786 2113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:58.907811 2113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:58.909260 2113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34725
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42989
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:58.909469 2113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:58.909634 2113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:58.914402 2118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:58.914397 2119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:58.914395 2121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:58.914631 2113 server_base.cc:1034] running on GCE node
I20260806 15:07:58.914862 2113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:58.915091 2113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:58.916260 2113 hybrid_clock.cc:648] HybridClock initialized: now 1786028878916244 us; error 42 us; skew 500 ppm
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:07:58.918843 2113 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:07:58.919229 2113 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:58.919301 2113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:58.919466 2113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:58.920446 2113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "2df1729e56f744ba8d25276fdafcedd2"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "a3c4372c2c9d0707bddd9c64730d51e2"
server_key_iv: "1377f65435d1a07bfdd660b89aa6d5d1"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.920789 2113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "2df1729e56f744ba8d25276fdafcedd2"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "a3c4372c2c9d0707bddd9c64730d51e2"
server_key_iv: "1377f65435d1a07bfdd660b89aa6d5d1"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.922245 2113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:58.923187 2127 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.923374 2113 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:58.923458 2113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "2df1729e56f744ba8d25276fdafcedd2"
format_stamp: "Formatted at 2026-08-06 15:07:58 on dist-test-slave-tm1g"
server_key: "a3c4372c2c9d0707bddd9c64730d51e2"
server_key_iv: "1377f65435d1a07bfdd660b89aa6d5d1"
server_key_version: "encryptionkey@0"
I20260806 15:07:58.923516 2113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:58.951028 2113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:58.952879 2113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:58.952993 2113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:58.953186 2113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:58.953518 2113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:58.953553 2113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.953575 2113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:58.953642 2113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:58.959939 2113 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:40699
I20260806 15:07:58.959978 2246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:40699 every 8 connection(s)
I20260806 15:07:58.960247 2113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:07:58 dist-test-slave-tm1g krb5kdc[1729](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028878, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:07:58.969601 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.960937 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:40891 (local address 127.29.69.190:42989)
0806 15:07:58.961005 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.961007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.961219 (+ 212us) server_negotiation.cc:407] Connection header received
0806 15:07:58.961752 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.961753 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.961766 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.961820 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:58.962850 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.963562 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.964578 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.964797 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.964882 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.967090 (+ 2208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:58.967092 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:58.967092 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:58.967099 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:58.968258 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.968657 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.968659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.968659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.968722 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.968968 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.968969 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.968970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.969088 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:58.969163 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.969430 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.969509 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:07:58.969781 2249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.960919 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42989 (local address 127.29.69.131:40891)
0806 15:07:58.961087 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:58.961132 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:58.961644 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:58.961907 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:58.961911 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:58.962193 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:58.962738 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.962744 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.963660 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.963662 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.964484 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.964486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.964896 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.964897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.965026 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.965559 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:07:58.965568 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:58.966994 (+ 1426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:58.968355 (+ 1361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:58.968363 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:58.968364 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:58.968581 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:58.968789 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:07:58.968790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:07:58.968790 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:07:58.968896 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:07:58.969155 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:58.969163 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:58.969297 (+ 134us) client_negotiation.cc:769] Sending connection context
0806 15:07:58.969403 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 15:07:58.969558 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
I20260806 15:07:58.970121 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2113
I20260806 15:07:58.970227 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:58.970355 2247 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42989
I20260806 15:07:58.970443 29974 external_mini_cluster.cc:1428] Setting key 89ee1d0606b72d2d97f7b64e59277bc8
I20260806 15:07:58.970458 2247 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:58.970605 2247 heartbeater.cc:511] Master 127.29.69.190:42989 requested a full tablet report, sending...
I20260806 15:07:58.971113 1774 ts_manager.cc:194] Registered new tserver with Master: 2df1729e56f744ba8d25276fdafcedd2 (127.29.69.131:40699)
I20260806 15:07:58.971509 1774 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:40891
I20260806 15:07:58.982153 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:07:58.988986 1814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.983507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59228 (local address 127.29.69.190:42989)
0806 15:07:58.983567 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.983569 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.983718 (+ 149us) server_negotiation.cc:407] Connection header received
0806 15:07:58.983737 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.983738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.983746 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.983783 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:58.984299 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.984755 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.985436 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.985608 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.985656 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.986750 (+ 1094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:58.986751 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:58.986752 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:07:58.986757 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:58.988082 (+ 1325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.988360 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.988361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.988361 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.988412 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:07:58.988554 (+ 142us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:07:58.988554 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:07:58.988555 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:07:58.988677 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:58.988745 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.988828 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.988884 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 15:07:58.990535 1774 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59228:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:58.992128 1774 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:58.998641 2260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.994502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:40699 (local address 127.0.0.1:52006)
0806 15:07:58.994774 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:58.994816 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:58.994883 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:58.995214 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:58.995215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:58.995217 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:58.995283 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.995285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.996233 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.996234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.997352 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.997355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.998292 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.998293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.998414 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.998430 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 15:07:58.998504 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 15:07:58.998560 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":245,"thread_start_us":77,"threads_started":1}
I20260806 15:07:58.998682 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.994593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52006 (local address 127.29.69.131:40699)
0806 15:07:58.994815 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.994820 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.994971 (+ 151us) server_negotiation.cc:407] Connection header received
0806 15:07:58.995015 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.995017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.995040 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.995128 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:58.995362 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.996136 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.997444 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.998193 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.998268 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.998349 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.998535 (+ 186us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.998579 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":90,"threads_started":1}
I20260806 15:07:58.998927 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.994550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54038 (local address 127.29.69.130:38759)
0806 15:07:58.994898 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.994902 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.994913 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:07:58.994963 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.994965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.994981 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.995057 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:58.995258 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.996423 (+ 1165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.997687 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.998271 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.998376 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.998440 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.998681 (+ 241us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.998834 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312,"thread_start_us":107,"threads_started":1}
I20260806 15:07:58.999010 2263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.994641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:42301 (local address 127.0.0.1:44560)
0806 15:07:58.995184 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:58.995193 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:58.995243 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:58.995463 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:58.995464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:58.995466 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:58.995520 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.995522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.996764 (+ 1242us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.996765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.997745 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.997747 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.998738 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.998739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.998826 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.998831 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:07:58.998886 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 15:07:58.998930 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":523,"thread_start_us":58,"threads_started":1}
I20260806 15:07:58.999259 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.994763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44560 (local address 127.29.69.129:42301)
0806 15:07:58.994980 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:58.994985 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:58.995305 (+ 320us) server_negotiation.cc:407] Connection header received
0806 15:07:58.995351 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:58.995353 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:58.995369 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:58.995445 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:58.995588 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.996656 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.997828 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.998570 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.998647 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.998699 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:58.999116 (+ 417us) server_negotiation.cc:299] Negotiation successful
0806 15:07:58.999174 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":185,"thread_start_us":86,"threads_started":1}
I20260806 15:07:58.999625 2177 tablet_service.cc:1467] Processing CreateTablet for tablet 616daa4cc8ba4d3089553affe43cc0ae (DEFAULT_TABLE table=test-table [id=62273800c5bb413fb23892c37b7d972f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:59.000000 2177 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616daa4cc8ba4d3089553affe43cc0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:58.999909 1902 tablet_service.cc:1467] Processing CreateTablet for tablet 616daa4cc8ba4d3089553affe43cc0ae (DEFAULT_TABLE table=test-table [id=62273800c5bb413fb23892c37b7d972f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:59.000222 1902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616daa4cc8ba4d3089553affe43cc0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.002417 2258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:58.994445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:38759 (local address 127.0.0.1:54038)
0806 15:07:58.994771 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:58.994815 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:58.994882 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:58.995092 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:58.995095 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:58.995097 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:58.995163 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.995165 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.996536 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.996537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.997598 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:58.997601 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:58.998474 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:58.998475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:58.998532 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:58.998535 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:58.998579 (+ 44us) client_negotiation.cc:240] Negotiation successful
0806 15:07:58.998613 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":9,"thread_start_us":46,"threads_started":1}
I20260806 15:07:59.003115 2038 tablet_service.cc:1467] Processing CreateTablet for tablet 616daa4cc8ba4d3089553affe43cc0ae (DEFAULT_TABLE table=test-table [id=62273800c5bb413fb23892c37b7d972f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:59.003465 2038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 616daa4cc8ba4d3089553affe43cc0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.003684 2265 tablet_bootstrap.cc:492] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: Bootstrap starting.
I20260806 15:07:59.004377 2265 tablet_bootstrap.cc:654] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.005036 2265 log.cc:824] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.003463 2266 tablet_bootstrap.cc:492] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Bootstrap starting.
I20260806 15:07:59.005959 2265 tablet_bootstrap.cc:492] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: No bootstrap required, opened a new log
I20260806 15:07:59.006036 2265 ts_tablet_manager.cc:1397] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:07:59.006266 2266 tablet_bootstrap.cc:654] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.006951 2266 log.cc:824] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.007396 2268 tablet_bootstrap.cc:492] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Bootstrap starting.
I20260806 15:07:59.007773 2266 tablet_bootstrap.cc:492] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: No bootstrap required, opened a new log
I20260806 15:07:59.007854 2266 ts_tablet_manager.cc:1397] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260806 15:07:59.007799 2265 raft_consensus.cc:348] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.008011 2265 raft_consensus.cc:374] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.008059 2265 raft_consensus.cc:729] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ff3539a35e746abaaa957b744845ed7, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.008070 2268 tablet_bootstrap.cc:654] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.008216 2265 consensus_queue.cc:260] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.008504 1971 heartbeater.cc:503] Master 127.29.69.190:42989 was elected leader, sending a full tablet report...
I20260806 15:07:59.008669 2268 log.cc:824] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.008504 2265 ts_tablet_manager.cc:1428] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 15:07:59.009492 2268 tablet_bootstrap.cc:492] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: No bootstrap required, opened a new log
I20260806 15:07:59.009564 2268 ts_tablet_manager.cc:1397] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:07:59.010007 2266 raft_consensus.cc:348] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.010182 2266 raft_consensus.cc:374] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.010216 2266 raft_consensus.cc:729] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2df1729e56f744ba8d25276fdafcedd2, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.010350 2266 consensus_queue.cc:260] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.010630 2266 ts_tablet_manager.cc:1428] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 15:07:59.010648 2247 heartbeater.cc:503] Master 127.29.69.190:42989 was elected leader, sending a full tablet report...
I20260806 15:07:59.011685 2268 raft_consensus.cc:348] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.011801 2268 raft_consensus.cc:374] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.011821 2268 raft_consensus.cc:729] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac115d34ff0d47f5916a03960fb909ec, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.011952 2268 consensus_queue.cc:260] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.012220 2268 ts_tablet_manager.cc:1428] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:59.012253 2108 heartbeater.cc:503] Master 127.29.69.190:42989 was elected leader, sending a full tablet report...
W20260806 15:07:59.046730 2109 tablet.cc:2369] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:59.121011 2272 raft_consensus.cc:482] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:59.121143 2272 raft_consensus.cc:504] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.121517 2272 leader_election.cc:288] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac115d34ff0d47f5916a03960fb909ec (127.29.69.130:38759), 4ff3539a35e746abaaa957b744845ed7 (127.29.69.129:42301)
I20260806 15:07:59.124626 2261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.121781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:53041 (local address 127.29.69.130:38759)
0806 15:07:59.121848 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.121850 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.121964 (+ 114us) server_negotiation.cc:407] Connection header received
0806 15:07:59.121998 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.121999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.122009 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.122068 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:59.122337 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.122866 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.123832 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.124249 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.124307 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.124314 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.124499 (+ 185us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.124547 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:07:59.124672 2264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.121918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:54633 (local address 127.29.69.129:42301)
0806 15:07:59.121969 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.121971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.122101 (+ 130us) server_negotiation.cc:407] Connection header received
0806 15:07:59.122148 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.122149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.122159 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.122214 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:07:59.122395 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.122958 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.123898 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.124276 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.124378 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.124386 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.124554 (+ 168us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.124600 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:07:59.124635 2249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.121708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:38759 (local address 127.29.69.131:53041)
0806 15:07:59.121822 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.121837 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.121906 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.122142 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.122143 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.122145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:59.122232 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:59.122235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.122938 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.122939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:59.123737 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:59.123739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.124329 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.124331 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:59.124420 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.124423 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.124474 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.124506 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260806 15:07:59.124917 2274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.121836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:42301 (local address 127.29.69.131:54633)
0806 15:07:59.122021 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.122030 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.122087 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.122223 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.122224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.122225 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:07:59.122333 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:59.122334 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.123042 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.123043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:59.123804 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:59.123807 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.124388 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.124389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:59.124452 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.124455 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.124531 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.124567 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":150,"threads_started":1}
I20260806 15:07:59.125077 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616daa4cc8ba4d3089553affe43cc0ae" candidate_uuid: "2df1729e56f744ba8d25276fdafcedd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac115d34ff0d47f5916a03960fb909ec" is_pre_election: true
I20260806 15:07:59.125247 2060 raft_consensus.cc:2454] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df1729e56f744ba8d25276fdafcedd2 in term 0.
I20260806 15:07:59.125532 2130 leader_election.cc:302] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df1729e56f744ba8d25276fdafcedd2, ac115d34ff0d47f5916a03960fb909ec; no voters:
I20260806 15:07:59.125672 2272 raft_consensus.cc:2781] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:59.125741 2272 raft_consensus.cc:482] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:59.125676 1922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616daa4cc8ba4d3089553affe43cc0ae" candidate_uuid: "2df1729e56f744ba8d25276fdafcedd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ff3539a35e746abaaa957b744845ed7" is_pre_election: true
I20260806 15:07:59.125770 2272 raft_consensus.cc:3037] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.125854 1922 raft_consensus.cc:2454] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2df1729e56f744ba8d25276fdafcedd2 in term 0.
I20260806 15:07:59.126592 2272 raft_consensus.cc:504] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.126732 2272 leader_election.cc:288] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [CANDIDATE]: Term 1 election: Requested vote from peers ac115d34ff0d47f5916a03960fb909ec (127.29.69.130:38759), 4ff3539a35e746abaaa957b744845ed7 (127.29.69.129:42301)
I20260806 15:07:59.126904 2060 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616daa4cc8ba4d3089553affe43cc0ae" candidate_uuid: "2df1729e56f744ba8d25276fdafcedd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac115d34ff0d47f5916a03960fb909ec"
I20260806 15:07:59.126943 1922 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "616daa4cc8ba4d3089553affe43cc0ae" candidate_uuid: "2df1729e56f744ba8d25276fdafcedd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ff3539a35e746abaaa957b744845ed7"
I20260806 15:07:59.126984 2060 raft_consensus.cc:3037] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.127038 1922 raft_consensus.cc:3037] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.127745 2060 raft_consensus.cc:2454] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df1729e56f744ba8d25276fdafcedd2 in term 1.
I20260806 15:07:59.127816 1922 raft_consensus.cc:2454] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2df1729e56f744ba8d25276fdafcedd2 in term 1.
I20260806 15:07:59.127951 2130 leader_election.cc:302] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2df1729e56f744ba8d25276fdafcedd2, 4ff3539a35e746abaaa957b744845ed7; no voters:
I20260806 15:07:59.128060 2272 raft_consensus.cc:2781] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:59.128233 2272 raft_consensus.cc:686] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 1 LEADER]: Becoming Leader. State: Replica: 2df1729e56f744ba8d25276fdafcedd2, State: Running, Role: LEADER
I20260806 15:07:59.128347 2272 consensus_queue.cc:237] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } }
I20260806 15:07:59.129281 1774 catalog_manager.cc:5495] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2df1729e56f744ba8d25276fdafcedd2 (127.29.69.131). New cstate: current_term: 1 leader_uuid: "2df1729e56f744ba8d25276fdafcedd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2df1729e56f744ba8d25276fdafcedd2" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 40699 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:59.142357 2262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.139935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52016 (local address 127.29.69.131:40699)
0806 15:07:59.139994 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.139996 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.140005 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:07:59.140042 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.140042 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.140059 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.140146 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:07:59.140295 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.140759 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.141512 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.141717 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.141793 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.141974 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:07:59.142081 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:07:59.142170 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.142211 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.142231 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:07:59.144138 1922 raft_consensus.cc:1261] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7 [term 1 FOLLOWER]: Refusing update from remote peer 2df1729e56f744ba8d25276fdafcedd2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:59.144447 2060 raft_consensus.cc:1261] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 1 FOLLOWER]: Refusing update from remote peer 2df1729e56f744ba8d25276fdafcedd2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:59.144521 2272 consensus_queue.cc:1035] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ff3539a35e746abaaa957b744845ed7" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42301 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:59.144771 2272 consensus_queue.cc:1035] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac115d34ff0d47f5916a03960fb909ec" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38759 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260806 15:07:59.145809 1972 tablet.cc:2369] T 616daa4cc8ba4d3089553affe43cc0ae P 4ff3539a35e746abaaa957b744845ed7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:07:59.147462 2279 mvcc.cc:205] Tried to move back new op lower bound from 7315574288971722752 to 7315574288910528512. Current Snapshot: MvccSnapshot[applied={T|T < 7315574288971722752}]
I20260806 15:07:59.147850 2280 mvcc.cc:205] Tried to move back new op lower bound from 7315574288971722752 to 7315574288910528512. Current Snapshot: MvccSnapshot[applied={T|T < 7315574288971722752}]
I20260806 15:07:59.149842 1775 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:59.149951 1775 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59228:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:59.150749 1775 catalog_manager.cc:5782] T 00000000000000000000000000000000 P ec0fb18de708484da5c21af0a6428668: Sending DeleteTablet for 3 replicas of tablet 616daa4cc8ba4d3089553affe43cc0ae
I20260806 15:07:59.151067 2177 tablet_service.cc:1514] Processing DeleteTablet for tablet 616daa4cc8ba4d3089553affe43cc0ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:59 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:52006
I20260806 15:07:59.151137 2038 tablet_service.cc:1514] Processing DeleteTablet for tablet 616daa4cc8ba4d3089553affe43cc0ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:59 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:54038
I20260806 15:07:59.151163 1902 tablet_service.cc:1514] Processing DeleteTablet for tablet 616daa4cc8ba4d3089553affe43cc0ae with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:59 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:44560
I20260806 15:07:59.151350 2288 tablet_replica.cc:330] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: stopping tablet replica
I20260806 15:07:59.151450 2288 raft_consensus.cc:2229] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:59.151546 2288 raft_consensus.cc:2258] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:59.151578 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1837
I20260806 15:07:59.156334 2288 ts_tablet_manager.cc:1905] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:59.157907 2287 tablet_replica.cc:330] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: stopping tablet replica
I20260806 15:07:59.158038 2287 raft_consensus.cc:2229] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:07:59.158192 2287 raft_consensus.cc:2258] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:59.158195 2288 ts_tablet_manager.cc:1918] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:59.158265 2288 log.cc:1196] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/616daa4cc8ba4d3089553affe43cc0ae
I20260806 15:07:59.158601 2288 ts_tablet_manager.cc:1939] T 616daa4cc8ba4d3089553affe43cc0ae P ac115d34ff0d47f5916a03960fb909ec: Deleting consensus metadata
I20260806 15:07:59.158934 2287 ts_tablet_manager.cc:1905] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:59.159070 1761 catalog_manager.cc:4841] TS ac115d34ff0d47f5916a03960fb909ec (127.29.69.130:38759): tablet 616daa4cc8ba4d3089553affe43cc0ae (table test-table [id=62273800c5bb413fb23892c37b7d972f]) successfully deleted
W20260806 15:07:59.160416 1761 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:42301 (error 108)
I20260806 15:07:59.160557 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1976
I20260806 15:07:59.161144 2287 ts_tablet_manager.cc:1918] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:59.161290 2287 log.cc:1196] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/616daa4cc8ba4d3089553affe43cc0ae
I20260806 15:07:59.161649 2258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.160820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:42301 (local address 127.0.0.1:44564)
0806 15:07:59.161569 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.161612 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:42301: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":722}
I20260806 15:07:59.161679 2287 ts_tablet_manager.cc:1939] T 616daa4cc8ba4d3089553affe43cc0ae P 2df1729e56f744ba8d25276fdafcedd2: Deleting consensus metadata
I20260806 15:07:59.162295 1762 catalog_manager.cc:4841] TS 2df1729e56f744ba8d25276fdafcedd2 (127.29.69.131:40699): tablet 616daa4cc8ba4d3089553affe43cc0ae (table test-table [id=62273800c5bb413fb23892c37b7d972f]) successfully deleted
W20260806 15:07:59.164160 1761 catalog_manager.cc:4584] TS 4ff3539a35e746abaaa957b744845ed7 (127.29.69.129:42301): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 616daa4cc8ba4d3089553affe43cc0ae: Network error: Client connection negotiation failed: client connection to 127.29.69.129:42301: connect: Connection refused (error 111)
I20260806 15:07:59.168103 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2113
I20260806 15:07:59.173228 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 1743
2026-08-06T15:07:59Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2025 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-06T15:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:59Z Disabled control of system clock
I20260806 15:07:59.201236 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:34151
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:34911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:34151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 15:07:59.282157 2294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:59.282419 2294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:59.282445 2294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:59.283592 2294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:59.283633 2294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:59.283645 2294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:59.283658 2294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:59.283670 2294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:07:59.285097 2294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:34151
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:34151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:59.285362 2294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:59.285665 2294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:59.290419 2303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.290431 2301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.290431 2300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:59.290695 2294 server_base.cc:1034] running on GCE node
I20260806 15:07:59.290969 2294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:59.291296 2294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:59.292484 2294 hybrid_clock.cc:648] HybridClock initialized: now 1786028879292460 us; error 39 us; skew 500 ppm
I20260806 15:07:59.294019 2294 webserver.cc:460] Webserver started at http://127.29.69.190:46847/ using document root <none> and password file <none>
I20260806 15:07:59.294344 2294 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:59.294412 2294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:59.294559 2294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:59.295665 2294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "2da255677504428ebf6da5a28a8cb062"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "e2192477bd3fa86a4fe5f5b68ddb2f20"
server_key_iv: "445ff66059202745e5cdd6749159d841"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.296032 2294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "2da255677504428ebf6da5a28a8cb062"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "e2192477bd3fa86a4fe5f5b68ddb2f20"
server_key_iv: "445ff66059202745e5cdd6749159d841"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.297359 2294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:07:59.298146 2309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.298399 2294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:59.298520 2294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "2da255677504428ebf6da5a28a8cb062"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "e2192477bd3fa86a4fe5f5b68ddb2f20"
server_key_iv: "445ff66059202745e5cdd6749159d841"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.298609 2294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:59.301971 2294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:59.302228 2294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:59.302407 2294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:59.306495 2294 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:34151
I20260806 15:07:59.306526 2363 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:34151 every 8 connection(s)
I20260806 15:07:59.306847 2294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:59.307499 2364 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.310248 2364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062: Bootstrap starting.
I20260806 15:07:59.310860 2364 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.311102 2364 log.cc:824] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.311694 2364 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062: No bootstrap required, opened a new log
I20260806 15:07:59.313184 2364 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2da255677504428ebf6da5a28a8cb062" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34151 } }
I20260806 15:07:59.313313 2364 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.313335 2364 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2da255677504428ebf6da5a28a8cb062, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.313476 2364 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2da255677504428ebf6da5a28a8cb062" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34151 } }
I20260806 15:07:59.313557 2364 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:59.313581 2364 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:59.313609 2364 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.314077 2364 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2da255677504428ebf6da5a28a8cb062" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34151 } }
I20260806 15:07:59.314159 2364 leader_election.cc:302] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2da255677504428ebf6da5a28a8cb062; no voters:
I20260806 15:07:59.314271 2364 leader_election.cc:288] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:59.314365 2367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:59.314527 2367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [term 1 LEADER]: Becoming Leader. State: Replica: 2da255677504428ebf6da5a28a8cb062, State: Running, Role: LEADER
I20260806 15:07:59.314607 2364 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:59.314610 2367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2da255677504428ebf6da5a28a8cb062" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34151 } }
I20260806 15:07:59.315030 2368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2da255677504428ebf6da5a28a8cb062" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2da255677504428ebf6da5a28a8cb062" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34151 } } }
I20260806 15:07:59.315196 2368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:59.315366 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2294
I20260806 15:07:59.315464 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:59.315659 29974 external_mini_cluster.cc:1428] Setting key c8330e5d9715824065cfdf9ca7f1050a
I20260806 15:07:59.315836 2369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2da255677504428ebf6da5a28a8cb062. Latest consensus state: current_term: 1 leader_uuid: "2da255677504428ebf6da5a28a8cb062" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2da255677504428ebf6da5a28a8cb062" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34151 } } }
I20260806 15:07:59.315936 2369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062 [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:59.315887 2376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:59.316982 2376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:59.318358 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.316305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39448 (local address 127.29.69.190:34151)
0806 15:07:59.316489 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.316498 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.316529 (+ 31us) server_negotiation.cc:407] Connection header received
0806 15:07:59.316664 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.316669 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.316702 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.316845 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.317894 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.317897 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.317897 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.317901 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.317934 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.317944 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.318028 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.318101 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.318158 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":78,"threads_started":1}
I20260806 15:07:59.318544 2376 catalog_manager.cc:1347] Generated new cluster ID: acc890416f2245baa4676777f508c6b4
I20260806 15:07:59.318584 2376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:07:59.333693 2376 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:59.333863 2376 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:59.336704 2376 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062: Generated new TSK 0
I20260806 15:07:59.336891 2376 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:07:59.344172 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34151
--builtin_ntp_servers=127.29.69.148:34911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 15:07:59.441658 2388 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:59.441864 2388 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:59.441886 2388 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:59.443118 2388 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:59.443158 2388 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:59.443184 2388 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:07:59.444489 2388 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2388
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:59.444715 2388 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:59.445019 2388 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:59.450062 2396 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.450193 2394 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.450057 2393 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:59.450446 2388 server_base.cc:1034] running on GCE node
I20260806 15:07:59.450645 2388 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:59.450881 2388 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:59.452035 2388 hybrid_clock.cc:648] HybridClock initialized: now 1786028879452015 us; error 32 us; skew 500 ppm
I20260806 15:07:59.453449 2388 webserver.cc:460] Webserver started at http://127.29.69.129:40175/ using document root <none> and password file <none>
I20260806 15:07:59.453704 2388 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:59.453760 2388 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:59.453890 2388 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:59.455248 2388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "f8941e8206c343b59d49865832abb704"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "02760a5b2680e5af2bfe72f4218bb89d"
server_key_iv: "ba7ff55f61f71acf58cf7aeb70698020"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.455651 2388 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "f8941e8206c343b59d49865832abb704"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "02760a5b2680e5af2bfe72f4218bb89d"
server_key_iv: "ba7ff55f61f71acf58cf7aeb70698020"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.457312 2388 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:07:59.458344 2402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.458542 2388 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:59.458647 2388 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "f8941e8206c343b59d49865832abb704"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "02760a5b2680e5af2bfe72f4218bb89d"
server_key_iv: "ba7ff55f61f71acf58cf7aeb70698020"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.458720 2388 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:59.463611 2388 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:59.463881 2388 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:59.464005 2388 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:59.464205 2388 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:59.464499 2388 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:59.464537 2388 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.464563 2388 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:59.464596 2388 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.471498 2388 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:39575
I20260806 15:07:59.471537 2517 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:39575 every 8 connection(s)
I20260806 15:07:59.471909 2388 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:07:59.475066 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.472708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:54557 (local address 127.29.69.190:34151)
0806 15:07:59.472777 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.472779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.473020 (+ 241us) server_negotiation.cc:407] Connection header received
0806 15:07:59.473510 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.473511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.473519 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.473565 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.474814 (+ 1249us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.474815 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.474816 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.474820 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.474837 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.474842 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.474893 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.474973 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.474990 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:07:59.475241 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.472690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34151 (local address 127.29.69.129:54557)
0806 15:07:59.472883 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.472921 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.473406 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.473631 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.473635 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.473644 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.474668 (+ 1024us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.474668 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.474694 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.474720 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.474890 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.474895 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.474898 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.474973 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.475034 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":106,"threads_started":1}
I20260806 15:07:59.475759 2518 heartbeater.cc:347] Connected to a master server at 127.29.69.190:34151
I20260806 15:07:59.475841 2518 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:59.475942 2518 heartbeater.cc:511] Master 127.29.69.190:34151 requested a full tablet report, sending...
I20260806 15:07:59.476402 2326 ts_manager.cc:194] Registered new tserver with Master: f8941e8206c343b59d49865832abb704 (127.29.69.129:39575)
I20260806 15:07:59.479655 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2388
I20260806 15:07:59.479732 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:07:59.479859 29974 external_mini_cluster.cc:1428] Setting key 285c20710caacf8501d458de0ba192b7
I20260806 15:07:59.480722 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34151
--builtin_ntp_servers=127.29.69.148:34911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 15:07:59.560613 2521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:59.560808 2521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:59.560830 2521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:59.561987 2521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:59.562026 2521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:59.562052 2521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:07:59.563500 2521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:59.563740 2521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:59.564043 2521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:59.569362 2526 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.569386 2527 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.569363 2529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:59.569592 2521 server_base.cc:1034] running on GCE node
I20260806 15:07:59.569797 2521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:59.570134 2521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:59.571277 2521 hybrid_clock.cc:648] HybridClock initialized: now 1786028879571256 us; error 43 us; skew 500 ppm
I20260806 15:07:59.572527 2521 webserver.cc:460] Webserver started at http://127.29.69.130:34569/ using document root <none> and password file <none>
I20260806 15:07:59.572772 2521 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:59.572817 2521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:59.572992 2521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:59.574010 2521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "d320634e43dd46848e538f213e660fa3"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "b3c8cb0ec71a230f5600ed3672430cbe"
server_key_iv: "f7adc7c94b6c05c6a0f55ea5982afcb6"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.574397 2521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "d320634e43dd46848e538f213e660fa3"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "b3c8cb0ec71a230f5600ed3672430cbe"
server_key_iv: "f7adc7c94b6c05c6a0f55ea5982afcb6"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.575861 2521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:07:59.576510 2535 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.576699 2521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:07:59.576789 2521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "d320634e43dd46848e538f213e660fa3"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "b3c8cb0ec71a230f5600ed3672430cbe"
server_key_iv: "f7adc7c94b6c05c6a0f55ea5982afcb6"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.576864 2521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:59.580160 2521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:59.580407 2521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:59.580547 2521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:59.580750 2521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:59.581056 2521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:59.581089 2521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.581144 2521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:59.581171 2521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.587846 2521 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:44531
I20260806 15:07:59.587880 2650 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:44531 every 8 connection(s)
I20260806 15:07:59.588199 2521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:07:59.591073 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.588904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:60155 (local address 127.29.69.190:34151)
0806 15:07:59.588988 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.588990 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.589185 (+ 195us) server_negotiation.cc:407] Connection header received
0806 15:07:59.589597 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.589598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.589603 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.589655 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.590884 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.590885 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.590885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.590888 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.590902 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.590906 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.590950 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.591010 (+ 60us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.591022 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 15:07:59.591274 2653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.588868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34151 (local address 127.29.69.130:60155)
0806 15:07:59.589062 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.589095 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.589517 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.589701 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.589704 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.589711 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.590757 (+ 1046us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.590758 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.590785 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.590811 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.590947 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.590949 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.590956 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.591006 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.591051 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":107,"threads_started":1}
I20260806 15:07:59.591753 2651 heartbeater.cc:347] Connected to a master server at 127.29.69.190:34151
I20260806 15:07:59.591828 2651 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:59.591991 2651 heartbeater.cc:511] Master 127.29.69.190:34151 requested a full tablet report, sending...
I20260806 15:07:59.592381 2326 ts_manager.cc:194] Registered new tserver with Master: d320634e43dd46848e538f213e660fa3 (127.29.69.130:44531)
I20260806 15:07:59.595245 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2521
I20260806 15:07:59.595352 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:07:59.595551 29974 external_mini_cluster.cc:1428] Setting key 99e2e124ed3009257c2ac71c58692694
I20260806 15:07:59.596356 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34151
--builtin_ntp_servers=127.29.69.148:34911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260806 15:07:59.677261 2654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:59.677477 2654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:59.677515 2654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:59.678740 2654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:59.678798 2654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:59.678845 2654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:07:59.680253 2654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:34911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:59.680510 2654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:59.680801 2654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:59.685823 2659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.685843 2660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.685806 2662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:59.686157 2654 server_base.cc:1034] running on GCE node
I20260806 15:07:59.686410 2654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:59.686635 2654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:59.687800 2654 hybrid_clock.cc:648] HybridClock initialized: now 1786028879687789 us; error 41 us; skew 500 ppm
I20260806 15:07:59.689049 2654 webserver.cc:460] Webserver started at http://127.29.69.131:38997/ using document root <none> and password file <none>
I20260806 15:07:59.689294 2654 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:59.689343 2654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:59.689532 2654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:59.690672 2654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "ef2cbe7dba91444989f148e5d3b209a9"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "0d6651e94d444b38bad91556d2767704"
server_key_iv: "c910dcf3504799f13f561dd4411a93b1"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.691025 2654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "ef2cbe7dba91444989f148e5d3b209a9"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "0d6651e94d444b38bad91556d2767704"
server_key_iv: "c910dcf3504799f13f561dd4411a93b1"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.692351 2654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:07:59.693041 2669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.693245 2654 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:07:59.693332 2654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "ef2cbe7dba91444989f148e5d3b209a9"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "0d6651e94d444b38bad91556d2767704"
server_key_iv: "c910dcf3504799f13f561dd4411a93b1"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.693387 2654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:59.696570 2654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:59.696779 2654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:59.696874 2654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:59.697029 2654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:07:59.697273 2654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:07:59.697302 2654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.697321 2654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:07:59.697335 2654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.703358 2654 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:38455
I20260806 15:07:59.703436 2787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:38455 every 8 connection(s)
I20260806 15:07:59.703735 2654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:07:59.706660 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.704454 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:43257 (local address 127.29.69.190:34151)
0806 15:07:59.704523 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.704525 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.704755 (+ 230us) server_negotiation.cc:407] Connection header received
0806 15:07:59.705180 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.705180 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.705185 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.705244 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.706471 (+ 1227us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.706472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.706472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.706475 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.706488 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.706491 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.706535 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.706592 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.706605 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 15:07:59.706856 2790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.704445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34151 (local address 127.29.69.131:43257)
0806 15:07:59.704617 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.704655 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.705101 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.705291 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.705294 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.705301 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.706273 (+ 972us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.706274 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.706355 (+ 81us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.706395 (+ 40us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.706533 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.706535 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.706537 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.706587 (+ 50us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.706632 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":85,"threads_started":1}
I20260806 15:07:59.707334 2788 heartbeater.cc:347] Connected to a master server at 127.29.69.190:34151
I20260806 15:07:59.707438 2788 heartbeater.cc:464] Registering TS with master...
I20260806 15:07:59.707597 2788 heartbeater.cc:511] Master 127.29.69.190:34151 requested a full tablet report, sending...
I20260806 15:07:59.707960 2326 ts_manager.cc:194] Registered new tserver with Master: ef2cbe7dba91444989f148e5d3b209a9 (127.29.69.131:38455)
I20260806 15:07:59.710949 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2654
I20260806 15:07:59.711051 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:07:59.711230 29974 external_mini_cluster.cc:1428] Setting key 274c7bc3676e611290f33f7cf85c5d2e
I20260806 15:07:59.712082 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:07:59.714604 2385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.713458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39450 (local address 127.29.69.190:34151)
0806 15:07:59.713517 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.713518 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.713672 (+ 154us) server_negotiation.cc:407] Connection header received
0806 15:07:59.713701 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.713702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.713706 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.713754 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.714412 (+ 658us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.714413 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.714413 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.714416 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.714429 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.714432 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.714474 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.714509 (+ 35us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.714520 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:07:59.716250 2326 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39450:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:07:59.717767 2326 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:07:59.721432 2796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.720005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38455 (local address 127.0.0.1:47278)
0806 15:07:59.720131 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.720169 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.720239 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.720482 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.720489 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.720495 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.720995 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.720996 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.721012 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.721036 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.721277 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.721285 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.721288 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.721335 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.721348 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":82,"threads_started":1}
I20260806 15:07:59.721699 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.720152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47278 (local address 127.29.69.131:38455)
0806 15:07:59.720316 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.720320 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.720332 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:07:59.720371 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.720374 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.720383 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.720469 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.721122 (+ 653us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.721130 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.721130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.721134 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.721171 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.721192 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.721561 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.721585 (+ 24us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.721603 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":70,"threads_started":1}
I20260806 15:07:59.722282 2797 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.720237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:39575 (local address 127.0.0.1:52382)
0806 15:07:59.720566 (+ 329us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.720576 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.720620 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.721432 (+ 812us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.721432 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.721434 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.721910 (+ 476us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.721910 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.721917 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.721928 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.722145 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.722146 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.722147 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.722203 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.722216 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":65,"threads_started":1}
I20260806 15:07:59.722280 2800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.720349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52382 (local address 127.29.69.129:39575)
0806 15:07:59.720764 (+ 415us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.720768 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.720778 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:07:59.720804 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.720807 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.720845 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.720912 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.722001 (+ 1089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.722013 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.722013 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.722022 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.722052 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.722071 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.722128 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.722206 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.722218 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":103,"threads_started":1}
I20260806 15:07:59.722399 2719 tablet_service.cc:1467] Processing CreateTablet for tablet 7895a8374aa143898c67b2d2d2fe032c (DEFAULT_TABLE table=test-table [id=917b3404eb5143919df894f8693c9ff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:59.722744 2719 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7895a8374aa143898c67b2d2d2fe032c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.725116 2802 tablet_bootstrap.cc:492] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Bootstrap starting.
I20260806 15:07:59.725829 2799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.720009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:44531 (local address 127.0.0.1:47690)
0806 15:07:59.720549 (+ 540us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.720559 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.720615 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.721159 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.721160 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.721162 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.721636 (+ 474us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.721637 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.721643 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.721658 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.725676 (+ 4018us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.725677 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.725678 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.725733 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.725746 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"thread_start_us":90,"threads_started":1}
I20260806 15:07:59.725878 2801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.720377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47690 (local address 127.29.69.130:44531)
0806 15:07:59.721021 (+ 644us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.721024 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.721032 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:07:59.721054 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.721056 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.721062 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.721159 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.721727 (+ 568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.721825 (+ 98us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.721825 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.721830 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.721901 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.721930 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.725646 (+ 3716us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.725768 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.725787 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":80,"threads_started":1}
I20260806 15:07:59.725894 2802 tablet_bootstrap.cc:654] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.725893 2452 tablet_service.cc:1467] Processing CreateTablet for tablet 7895a8374aa143898c67b2d2d2fe032c (DEFAULT_TABLE table=test-table [id=917b3404eb5143919df894f8693c9ff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:59.726225 2802 log.cc:824] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.726260 2452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7895a8374aa143898c67b2d2d2fe032c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.726806 2585 tablet_service.cc:1467] Processing CreateTablet for tablet 7895a8374aa143898c67b2d2d2fe032c (DEFAULT_TABLE table=test-table [id=917b3404eb5143919df894f8693c9ff5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:07:59.727087 2802 tablet_bootstrap.cc:492] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: No bootstrap required, opened a new log
I20260806 15:07:59.727154 2585 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7895a8374aa143898c67b2d2d2fe032c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.727160 2802 ts_tablet_manager.cc:1397] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:07:59.728942 2804 tablet_bootstrap.cc:492] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704: Bootstrap starting.
I20260806 15:07:59.729655 2804 tablet_bootstrap.cc:654] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.729736 2802 raft_consensus.cc:348] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.729911 2802 raft_consensus.cc:374] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.729966 2802 raft_consensus.cc:729] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef2cbe7dba91444989f148e5d3b209a9, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.730033 2804 log.cc:824] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.730082 2802 consensus_queue.cc:260] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.730389 2802 ts_tablet_manager.cc:1428] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260806 15:07:59.730515 2788 heartbeater.cc:503] Master 127.29.69.190:34151 was elected leader, sending a full tablet report...
I20260806 15:07:59.730461 2805 tablet_bootstrap.cc:492] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Bootstrap starting.
I20260806 15:07:59.730954 2804 tablet_bootstrap.cc:492] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704: No bootstrap required, opened a new log
I20260806 15:07:59.731034 2804 ts_tablet_manager.cc:1397] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:59.731400 2805 tablet_bootstrap.cc:654] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.731707 2805 log.cc:824] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.732438 2805 tablet_bootstrap.cc:492] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: No bootstrap required, opened a new log
I20260806 15:07:59.732506 2805 ts_tablet_manager.cc:1397] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:07:59.733721 2804 raft_consensus.cc:348] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.733914 2804 raft_consensus.cc:374] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.733950 2804 raft_consensus.cc:729] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8941e8206c343b59d49865832abb704, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.734061 2804 consensus_queue.cc:260] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.734349 2804 ts_tablet_manager.cc:1428] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 15:07:59.734390 2518 heartbeater.cc:503] Master 127.29.69.190:34151 was elected leader, sending a full tablet report...
I20260806 15:07:59.735046 2805 raft_consensus.cc:348] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.735157 2805 raft_consensus.cc:374] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.735201 2805 raft_consensus.cc:729] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d320634e43dd46848e538f213e660fa3, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.735316 2805 consensus_queue.cc:260] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.735580 2805 ts_tablet_manager.cc:1428] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:07:59.735621 2651 heartbeater.cc:503] Master 127.29.69.190:34151 was elected leader, sending a full tablet report...
I20260806 15:07:59.761849 2809 raft_consensus.cc:482] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:07:59.761972 2809 raft_consensus.cc:504] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.762475 2809 leader_election.cc:288] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d320634e43dd46848e538f213e660fa3 (127.29.69.130:44531), ef2cbe7dba91444989f148e5d3b209a9 (127.29.69.131:38455)
I20260806 15:07:59.763936 2520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.762684 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:44531 (local address 127.29.69.129:58559)
0806 15:07:59.762787 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.762799 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.762856 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.762986 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.762988 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.762990 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.763496 (+ 506us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.763497 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.763506 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.763521 (+ 15us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.763762 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.763763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.763764 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.763839 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.763853 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260806 15:07:59.763957 2801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.762808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:58559 (local address 127.29.69.130:44531)
0806 15:07:59.762852 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.762854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.762864 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:07:59.762930 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.762930 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.762935 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.762985 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.763617 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.763620 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.763621 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.763645 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.763667 (+ 22us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.763673 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.763739 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.763840 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.763855 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:07:59.764029 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.762868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:35867 (local address 127.29.69.131:38455)
0806 15:07:59.762917 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.762919 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.763028 (+ 109us) server_negotiation.cc:407] Connection header received
0806 15:07:59.763114 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.763115 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.763120 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.763179 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.763794 (+ 615us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.763796 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.763796 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.763802 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.763822 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.763828 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.763883 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.763925 (+ 42us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.763938 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:07:59.764053 2811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.762698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38455 (local address 127.29.69.129:35867)
0806 15:07:59.762945 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.762955 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.763048 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.763184 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.763184 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.763187 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:07:59.763686 (+ 499us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:07:59.763687 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:07:59.763693 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:07:59.763707 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:07:59.763879 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:07:59.763880 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:07:59.763881 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 15:07:59.763927 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 15:07:59.763939 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":230,"mutex_wait_us":22,"thread_start_us":115,"threads_started":1}
I20260806 15:07:59.764241 2605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7895a8374aa143898c67b2d2d2fe032c" candidate_uuid: "f8941e8206c343b59d49865832abb704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d320634e43dd46848e538f213e660fa3" is_pre_election: true
I20260806 15:07:59.764346 2605 raft_consensus.cc:2454] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8941e8206c343b59d49865832abb704 in term 0.
I20260806 15:07:59.764350 2739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7895a8374aa143898c67b2d2d2fe032c" candidate_uuid: "f8941e8206c343b59d49865832abb704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2cbe7dba91444989f148e5d3b209a9" is_pre_election: true
I20260806 15:07:59.764457 2739 raft_consensus.cc:2454] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f8941e8206c343b59d49865832abb704 in term 0.
I20260806 15:07:59.764619 2405 leader_election.cc:302] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d320634e43dd46848e538f213e660fa3, f8941e8206c343b59d49865832abb704; no voters:
I20260806 15:07:59.764739 2809 raft_consensus.cc:2781] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:07:59.764796 2809 raft_consensus.cc:482] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:07:59.764824 2809 raft_consensus.cc:3037] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.765523 2809 raft_consensus.cc:504] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.765657 2809 leader_election.cc:288] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [CANDIDATE]: Term 1 election: Requested vote from peers d320634e43dd46848e538f213e660fa3 (127.29.69.130:44531), ef2cbe7dba91444989f148e5d3b209a9 (127.29.69.131:38455)
I20260806 15:07:59.765800 2739 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7895a8374aa143898c67b2d2d2fe032c" candidate_uuid: "f8941e8206c343b59d49865832abb704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef2cbe7dba91444989f148e5d3b209a9"
I20260806 15:07:59.765817 2605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7895a8374aa143898c67b2d2d2fe032c" candidate_uuid: "f8941e8206c343b59d49865832abb704" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d320634e43dd46848e538f213e660fa3"
I20260806 15:07:59.765895 2605 raft_consensus.cc:3037] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.765906 2739 raft_consensus.cc:3037] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.766834 2605 raft_consensus.cc:2454] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8941e8206c343b59d49865832abb704 in term 1.
I20260806 15:07:59.766845 2739 raft_consensus.cc:2454] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f8941e8206c343b59d49865832abb704 in term 1.
I20260806 15:07:59.766988 2405 leader_election.cc:302] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d320634e43dd46848e538f213e660fa3, f8941e8206c343b59d49865832abb704; no voters:
I20260806 15:07:59.767088 2809 raft_consensus.cc:2781] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:59.767225 2809 raft_consensus.cc:686] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [term 1 LEADER]: Becoming Leader. State: Replica: f8941e8206c343b59d49865832abb704, State: Running, Role: LEADER
I20260806 15:07:59.767329 2809 consensus_queue.cc:237] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } }
I20260806 15:07:59.768204 2326 catalog_manager.cc:5495] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 reported cstate change: term changed from 0 to 1, leader changed from <none> to f8941e8206c343b59d49865832abb704 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "f8941e8206c343b59d49865832abb704" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f8941e8206c343b59d49865832abb704" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39575 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 } health_report { overall_health: UNKNOWN } } }
I20260806 15:07:59.781385 2800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.780545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52398 (local address 127.29.69.129:39575)
0806 15:07:59.780588 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.780606 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.780613 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:07:59.780664 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.780665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.780685 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.780734 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.781220 (+ 486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.781221 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.781221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.781225 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.781239 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.781243 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.781294 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.781327 (+ 33us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.781338 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:07:59.783143 2739 raft_consensus.cc:1261] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 1 FOLLOWER]: Refusing update from remote peer f8941e8206c343b59d49865832abb704: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:59.783154 2605 raft_consensus.cc:1261] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 1 FOLLOWER]: Refusing update from remote peer f8941e8206c343b59d49865832abb704: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:07:59.783495 2812 consensus_queue.cc:1035] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef2cbe7dba91444989f148e5d3b209a9" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:59.783629 2809 consensus_queue.cc:1035] T 7895a8374aa143898c67b2d2d2fe032c P f8941e8206c343b59d49865832abb704 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d320634e43dd46848e538f213e660fa3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 44531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:07:59.785961 2817 mvcc.cc:205] Tried to move back new op lower bound from 7315574291589173248 to 7315574291527774208. Current Snapshot: MvccSnapshot[applied={T|T < 7315574291589173248}]
I20260806 15:07:59.786445 2815 mvcc.cc:205] Tried to move back new op lower bound from 7315574291589173248 to 7315574291527774208. Current Snapshot: MvccSnapshot[applied={T|T < 7315574291589173248 or (T in {7315574291589173248})}]
I20260806 15:07:59.786573 2816 mvcc.cc:205] Tried to move back new op lower bound from 7315574291589173248 to 7315574291527774208. Current Snapshot: MvccSnapshot[applied={T|T < 7315574291589173248}]
I20260806 15:07:59.787899 2325 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:59.787978 2325 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39450:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:07:59.788710 2325 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2da255677504428ebf6da5a28a8cb062: Sending DeleteTablet for 3 replicas of tablet 7895a8374aa143898c67b2d2d2fe032c
I20260806 15:07:59.789103 2585 tablet_service.cc:1514] Processing DeleteTablet for tablet 7895a8374aa143898c67b2d2d2fe032c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:59 UTC) from {username='slave'} at 127.0.0.1:47690
I20260806 15:07:59.789354 2826 tablet_replica.cc:330] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: stopping tablet replica
I20260806 15:07:59.789321 2452 tablet_service.cc:1514] Processing DeleteTablet for tablet 7895a8374aa143898c67b2d2d2fe032c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:59 UTC) from {username='slave'} at 127.0.0.1:52382
I20260806 15:07:59.789392 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2388
I20260806 15:07:59.789461 2826 raft_consensus.cc:2229] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:59.789557 2826 raft_consensus.cc:2258] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:59.790001 2719 tablet_service.cc:1514] Processing DeleteTablet for tablet 7895a8374aa143898c67b2d2d2fe032c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:07:59 UTC) from {username='slave'} at 127.0.0.1:47278
I20260806 15:07:59.790098 2826 ts_tablet_manager.cc:1905] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:59.790330 2827 tablet_replica.cc:330] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: stopping tablet replica
I20260806 15:07:59.790417 2827 raft_consensus.cc:2229] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:07:59.790503 2827 raft_consensus.cc:2258] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:07:59.790973 2827 ts_tablet_manager.cc:1905] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:07:59.792163 2827 ts_tablet_manager.cc:1918] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:59.792215 2827 log.cc:1196] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/7895a8374aa143898c67b2d2d2fe032c
I20260806 15:07:59.792204 2826 ts_tablet_manager.cc:1918] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:07:59.792273 2826 log.cc:1196] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/7895a8374aa143898c67b2d2d2fe032c
I20260806 15:07:59.792405 2827 ts_tablet_manager.cc:1939] T 7895a8374aa143898c67b2d2d2fe032c P ef2cbe7dba91444989f148e5d3b209a9: Deleting consensus metadata
I20260806 15:07:59.792536 2826 ts_tablet_manager.cc:1939] T 7895a8374aa143898c67b2d2d2fe032c P d320634e43dd46848e538f213e660fa3: Deleting consensus metadata
I20260806 15:07:59.792867 2311 catalog_manager.cc:4841] TS ef2cbe7dba91444989f148e5d3b209a9 (127.29.69.131:38455): tablet 7895a8374aa143898c67b2d2d2fe032c (table test-table [id=917b3404eb5143919df894f8693c9ff5]) successfully deleted
I20260806 15:07:59.792899 2312 catalog_manager.cc:4841] TS d320634e43dd46848e538f213e660fa3 (127.29.69.130:44531): tablet 7895a8374aa143898c67b2d2d2fe032c (table test-table [id=917b3404eb5143919df894f8693c9ff5]) successfully deleted
W20260806 15:07:59.797662 2312 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:39575 (error 108)
I20260806 15:07:59.797899 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2521
I20260806 15:07:59.798729 2799 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.798055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:39575 (local address 127.0.0.1:52408)
0806 15:07:59.798640 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.798685 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:39575: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":563}
W20260806 15:07:59.799687 2312 catalog_manager.cc:4584] TS f8941e8206c343b59d49865832abb704 (127.29.69.129:39575): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7895a8374aa143898c67b2d2d2fe032c: Network error: Client connection negotiation failed: client connection to 127.29.69.129:39575: connect: Connection refused (error 111)
I20260806 15:07:59.803246 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2654
I20260806 15:07:59.810177 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2294
2026-08-06T15:07:59Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (636 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260806 15:07:59.830274 29974 mini_oidc.cc:152] Starting JWKS server
I20260806 15:07:59.831580 29974 webserver.cc:460] Webserver started at https://127.0.0.1:45609/ using document root <none> and password file <none>
I20260806 15:07:59.831687 29974 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 15:07:59.831872 29974 webserver.cc:460] Webserver started at http://127.0.0.1:35671/ using document root <none> and password file <none>
2026-08-06T15:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:07:59Z Disabled control of system clock
I20260806 15:07:59.839613 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:43681
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:40637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:43681
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45609/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/testchainca.cert with env {}
W20260806 15:07:59.921694 2835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:07:59.921883 2835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:07:59.921905 2835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:07:59.923110 2835 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:07:59.923151 2835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:07:59.923164 2835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:07:59.923223 2835 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:07:59.923242 2835 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 15:07:59.923259 2835 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 15:07:59.923285 2835 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:45609/jwks.json
I20260806 15:07:59.924795 2835 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:43681
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:43681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:45609/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:07:59.925040 2835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:07:59.925261 2835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:07:59.929848 2841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.929853 2843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:07:59.929854 2840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:07:59.930087 2835 server_base.cc:1034] running on GCE node
I20260806 15:07:59.930351 2835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:07:59.930677 2835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:07:59.931828 2835 hybrid_clock.cc:648] HybridClock initialized: now 1786028879931813 us; error 29 us; skew 500 ppm
I20260806 15:07:59.933012 2835 webserver.cc:460] Webserver started at http://127.29.69.190:36917/ using document root <none> and password file <none>
I20260806 15:07:59.933250 2835 fs_manager.cc:359] Metadata directory not provided
I20260806 15:07:59.933295 2835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:07:59.933434 2835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:07:59.934463 2835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "a72b3438b790413ca0bd8decedefa8ac"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "0d5399907aac7f6df823c30a6a474537"
server_key_iv: "6cd4add005f8837e076afe6bf15e51cf"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.934824 2835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "a72b3438b790413ca0bd8decedefa8ac"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "0d5399907aac7f6df823c30a6a474537"
server_key_iv: "6cd4add005f8837e076afe6bf15e51cf"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.936162 2835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:07:59.936802 2849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.936977 2835 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:07:59.937045 2835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "a72b3438b790413ca0bd8decedefa8ac"
format_stamp: "Formatted at 2026-08-06 15:07:59 on dist-test-slave-tm1g"
server_key: "0d5399907aac7f6df823c30a6a474537"
server_key_iv: "6cd4add005f8837e076afe6bf15e51cf"
server_key_version: "encryptionkey@0"
I20260806 15:07:59.937095 2835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:07:59.956691 2835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:07:59.956935 2835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:07:59.957037 2835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:07:59.960861 2835 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:43681
I20260806 15:07:59.960894 2902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:43681 every 8 connection(s)
I20260806 15:07:59.961213 2835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:07:59.962178 2903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:07:59.963843 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2835
I20260806 15:07:59.963955 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:07:59.964121 29974 external_mini_cluster.cc:1428] Setting key 2779b3ba50865547d209e920406d6f1d
I20260806 15:07:59.964638 2903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac: Bootstrap starting.
I20260806 15:07:59.965296 2903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac: Neither blocks nor log segments found. Creating new log.
I20260806 15:07:59.965734 2903 log.cc:824] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac: Log is configured to *not* fsync() on all Append() calls
I20260806 15:07:59.966518 2903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac: No bootstrap required, opened a new log
I20260806 15:07:59.968901 2903 raft_consensus.cc:348] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a72b3438b790413ca0bd8decedefa8ac" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43681 } }
I20260806 15:07:59.969075 2903 raft_consensus.cc:374] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:07:59.969125 2903 raft_consensus.cc:729] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a72b3438b790413ca0bd8decedefa8ac, State: Initialized, Role: FOLLOWER
I20260806 15:07:59.969249 2903 consensus_queue.cc:260] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a72b3438b790413ca0bd8decedefa8ac" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43681 } }
I20260806 15:07:59.969347 2903 raft_consensus.cc:388] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:07:59.969395 2903 raft_consensus.cc:482] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:07:59.969455 2903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:07:59.969821 2906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:07:59.964669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32802 (local address 127.29.69.190:43681)
0806 15:07:59.964864 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0806 15:07:59.964870 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:07:59.964895 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:07:59.965275 (+ 380us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:07:59.965281 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:07:59.965335 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:07:59.965522 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:07:59.965777 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.966753 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.967848 (+ 1095us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.968226 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.968309 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.969031 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:07:59.969035 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:07:59.969035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:07:59.969239 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:07:59.969272 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:07:59.969283 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:07:59.969333 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:07:59.969485 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 15:07:59.969666 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":94,"threads_started":1}
I20260806 15:07:59.970029 2903 raft_consensus.cc:504] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a72b3438b790413ca0bd8decedefa8ac" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43681 } }
I20260806 15:07:59.970144 2903 leader_election.cc:302] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a72b3438b790413ca0bd8decedefa8ac; no voters:
I20260806 15:07:59.970293 2903 leader_election.cc:288] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:07:59.970347 2909 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:07:59.970515 2909 raft_consensus.cc:686] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [term 1 LEADER]: Becoming Leader. State: Replica: a72b3438b790413ca0bd8decedefa8ac, State: Running, Role: LEADER
I20260806 15:07:59.970571 2903 sys_catalog.cc:564] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:07:59.970607 2909 consensus_queue.cc:237] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a72b3438b790413ca0bd8decedefa8ac" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43681 } }
I20260806 15:07:59.970937 2911 sys_catalog.cc:455] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a72b3438b790413ca0bd8decedefa8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a72b3438b790413ca0bd8decedefa8ac" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43681 } } }
I20260806 15:07:59.971014 2911 sys_catalog.cc:458] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:59.970924 2909 sys_catalog.cc:455] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader a72b3438b790413ca0bd8decedefa8ac. Latest consensus state: current_term: 1 leader_uuid: "a72b3438b790413ca0bd8decedefa8ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a72b3438b790413ca0bd8decedefa8ac" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43681 } } }
I20260806 15:07:59.971166 2909 sys_catalog.cc:458] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac [sys.catalog]: This master's current role is: LEADER
I20260806 15:07:59.971278 2915 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:07:59.971607 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:07:59.971964 2915 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:07:59.973536 2915 catalog_manager.cc:1347] Generated new cluster ID: 39eca18f1b7548a6af053a1ccbf39c3a
I20260806 15:07:59.973592 2915 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:07:59.985176 2915 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:07:59.985850 2915 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:07:59.988384 2915 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a72b3438b790413ca0bd8decedefa8ac: Generated new TSK 0
I20260806 15:07:59.988535 2915 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 15:08:00.009799 2934 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260806 15:08:00.009972 2934 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
W20260806 15:08:00.010582 2933 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:07:59.994998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:43681 (local address 127.0.0.1:32804)
0806 15:07:59.995184 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 15:07:59.995194 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:07:59.995277 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:07:59.995437 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:07:59.995438 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:07:59.995439 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0806 15:07:59.995504 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:59.995507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.996412 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.996413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:59.997022 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:07:59.997024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:07:59.997412 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:07:59.997414 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:07:59.997477 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:07:59.997505 (+ 28us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 15:08:00.010107 (+ 12602us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0806 15:08:00.010216 (+ 109us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.69.190:43681: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":76,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.29.69.190:43681: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:45609/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260806 15:08:00.011045 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2835
2026-08-06T15:08:00Z chronyd exiting
I20260806 15:08:00.048103 29974 test_util.cc:175] -----------------------------------------------
I20260806 15:08:00.048198 29974 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786028857624334-29974-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (218 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260806 15:08:00.049055 29974 mini_oidc.cc:152] Starting JWKS server
I20260806 15:08:00.049750 29974 webserver.cc:460] Webserver started at https://127.0.0.1:44785/ using document root <none> and password file <none>
I20260806 15:08:00.049818 29974 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 15:08:00.049983 29974 webserver.cc:460] Webserver started at http://127.0.0.1:45135/ using document root <none> and password file <none>
2026-08-06T15:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:00Z Disabled control of system clock
I20260806 15:08:00.057977 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36995
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:44629
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:36995
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44785/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/testchainca.cert with env {}
W20260806 15:08:00.137845 2940 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:00.138041 2940 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:00.138064 2940 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:00.139178 2940 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:00.139214 2940 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:00.139227 2940 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:00.139240 2940 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:00.139252 2940 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 15:08:00.139264 2940 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 15:08:00.139276 2940 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44785/jwks.json
I20260806 15:08:00.140727 2940 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44629
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:36995
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44785/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2940
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:00.140916 2940 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:00.141073 2940 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:00.145951 2946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:00.145957 2945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:00.146164 2940 server_base.cc:1034] running on GCE node
W20260806 15:08:00.145973 2948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:00.146495 2940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:00.146797 2940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:00.147964 2940 hybrid_clock.cc:648] HybridClock initialized: now 1786028880147947 us; error 43 us; skew 500 ppm
I20260806 15:08:00.149096 2940 webserver.cc:460] Webserver started at http://127.29.69.190:40771/ using document root <none> and password file <none>
I20260806 15:08:00.149345 2940 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:00.149427 2940 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:00.149602 2940 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:00.150761 2940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "d96638ae288944e4b07b2d325a6056de"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "8cfc929531ff4f2a8cd483798c3ba2cc"
server_key_iv: "82c2329b72079804c8c568e3f4a8fde9"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.151155 2940 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "d96638ae288944e4b07b2d325a6056de"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "8cfc929531ff4f2a8cd483798c3ba2cc"
server_key_iv: "82c2329b72079804c8c568e3f4a8fde9"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.152534 2940 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 15:08:00.153234 2954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:00.153407 2940 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:00.153527 2940 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "d96638ae288944e4b07b2d325a6056de"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "8cfc929531ff4f2a8cd483798c3ba2cc"
server_key_iv: "82c2329b72079804c8c568e3f4a8fde9"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.153601 2940 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:00.163462 2940 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:00.163730 2940 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:00.163877 2940 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:00.167623 2940 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:36995
I20260806 15:08:00.167687 3009 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:36995 every 8 connection(s)
I20260806 15:08:00.168009 2940 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:00.168697 3010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:00.171392 3010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de: Bootstrap starting.
I20260806 15:08:00.172009 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 2940
I20260806 15:08:00.172026 3010 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:00.172122 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:00.172312 29974 external_mini_cluster.cc:1428] Setting key a6d6b8bf1bd56500a6fea953a61188e6
I20260806 15:08:00.172369 3010 log.cc:824] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:00.173251 3010 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de: No bootstrap required, opened a new log
I20260806 15:08:00.175235 3010 raft_consensus.cc:348] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d96638ae288944e4b07b2d325a6056de" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36995 } }
I20260806 15:08:00.175390 3010 raft_consensus.cc:374] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:00.175441 3010 raft_consensus.cc:729] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d96638ae288944e4b07b2d325a6056de, State: Initialized, Role: FOLLOWER
I20260806 15:08:00.175570 3010 consensus_queue.cc:260] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d96638ae288944e4b07b2d325a6056de" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36995 } }
I20260806 15:08:00.175678 3010 raft_consensus.cc:388] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:00.175722 3010 raft_consensus.cc:482] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:00.175770 3010 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:00.176337 3010 raft_consensus.cc:504] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d96638ae288944e4b07b2d325a6056de" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36995 } }
I20260806 15:08:00.176448 3010 leader_election.cc:302] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d96638ae288944e4b07b2d325a6056de; no voters:
I20260806 15:08:00.176626 3010 leader_election.cc:288] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:00.176662 3015 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:00.176798 3015 raft_consensus.cc:686] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [term 1 LEADER]: Becoming Leader. State: Replica: d96638ae288944e4b07b2d325a6056de, State: Running, Role: LEADER
I20260806 15:08:00.176887 3010 sys_catalog.cc:564] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:00.176895 3015 consensus_queue.cc:237] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d96638ae288944e4b07b2d325a6056de" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36995 } }
I20260806 15:08:00.177273 3015 sys_catalog.cc:455] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [sys.catalog]: SysCatalogTable state changed. Reason: New leader d96638ae288944e4b07b2d325a6056de. Latest consensus state: current_term: 1 leader_uuid: "d96638ae288944e4b07b2d325a6056de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d96638ae288944e4b07b2d325a6056de" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36995 } } }
I20260806 15:08:00.177366 3015 sys_catalog.cc:458] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:00.177583 3022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:00.177284 3017 sys_catalog.cc:455] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d96638ae288944e4b07b2d325a6056de" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d96638ae288944e4b07b2d325a6056de" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36995 } } }
I20260806 15:08:00.177805 3014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:00.172840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59510 (local address 127.29.69.190:36995)
0806 15:08:00.173054 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:00.173062 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:00.173092 (+ 30us) server_negotiation.cc:407] Connection header received
0806 15:08:00.173594 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:00.173601 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:00.173658 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:00.173801 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:00.174029 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.174931 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.175824 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.176240 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.176326 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.177073 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:00.177077 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:00.177077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:00.177306 (+ 229us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:00.177348 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:00.177363 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:00.177430 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:00.177540 (+ 110us) server_negotiation.cc:299] Negotiation successful
0806 15:08:00.177626 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260806 15:08:00.177831 3017 sys_catalog.cc:458] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:00.178032 3022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:00.179004 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:08:00.180554 3022 catalog_manager.cc:1347] Generated new cluster ID: 7f220ad438d74125adbe2dfd0d293f5c
I20260806 15:08:00.180627 3022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:00.186463 3022 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:00.186933 3022 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:00.190267 3022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d96638ae288944e4b07b2d325a6056de: Generated new TSK 0
I20260806 15:08:00.190454 3022 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260806 15:08:00.215006 3040 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260806 15:08:00.215097 3040 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260806 15:08:00.215382 3014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:00.201202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59520 (local address 127.29.69.190:36995)
0806 15:08:00.201264 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:00.201266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:00.201307 (+ 41us) server_negotiation.cc:407] Connection header received
0806 15:08:00.201375 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:00.201377 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:00.201394 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:00.201497 (+ 103us) server_negotiation.cc:226] Negotiated authn=JWT
0806 15:08:00.201613 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.202406 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.203175 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.203500 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.203571 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.203719 (+ 148us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 15:08:00.215178 (+ 11459us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44785/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 15:08:00.215312 (+ 134us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59520: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44785/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":37}
W20260806 15:08:00.215446 3014 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59520: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44785/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260806 15:08:00.215461 3039 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:00.201077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36995 (local address 127.0.0.1:59520)
0806 15:08:00.201252 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:00.201267 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:00.201315 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:00.201499 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:00.201500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:00.201502 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 15:08:00.201552 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:00.201554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.202509 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.202510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:00.203098 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:00.203100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.203584 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.203585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:00.203629 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.203633 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 15:08:00.215281 (+ 11648us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44785/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0806 15:08:00.215365 (+ 84us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.69.190:36995: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44785/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":102,"threads_started":1}
I20260806 15:08:00.215786 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 2940
2026-08-06T15:08:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (204 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260806 15:08:00.253813 29974 mini_oidc.cc:152] Starting JWKS server
I20260806 15:08:00.254582 29974 webserver.cc:460] Webserver started at https://127.0.0.1:42919/ using document root <none> and password file <none>
I20260806 15:08:00.254652 29974 mini_oidc.cc:189] Starting OIDC Discovery server
I20260806 15:08:00.254817 29974 webserver.cc:460] Webserver started at http://127.0.0.1:39089/ using document root <none> and password file <none>
2026-08-06T15:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:00Z Disabled control of system clock
I20260806 15:08:00.263305 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:39227
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:45891
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:39227
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42919/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 15:08:00.345772 3047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:00.345968 3047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:00.345989 3047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:00.347119 3047 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:00.347158 3047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:00.347172 3047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:00.347183 3047 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:00.347195 3047 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 15:08:00.347208 3047 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 15:08:00.347219 3047 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42919/jwks.json
I20260806 15:08:00.348604 3047 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45891
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:39227
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:39227
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42919/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:00.348790 3047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:00.349004 3047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:00.353673 3053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:00.353678 3055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:00.353741 3052 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:00.353834 3047 server_base.cc:1034] running on GCE node
I20260806 15:08:00.354112 3047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:00.354470 3047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:00.355635 3047 hybrid_clock.cc:648] HybridClock initialized: now 1786028880355624 us; error 45 us; skew 500 ppm
I20260806 15:08:00.357223 3047 webserver.cc:460] Webserver started at http://127.29.69.190:35357/ using document root <none> and password file <none>
I20260806 15:08:00.357470 3047 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:00.357539 3047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:00.357692 3047 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:00.358853 3047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "b5e1ee4851b246ad981430aa5274c69c"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "1d79914883301757b738e6311697a1e9"
server_key_iv: "bff9a8e293a6dd40ddccbd3c5d7baa52"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.359258 3047 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "b5e1ee4851b246ad981430aa5274c69c"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "1d79914883301757b738e6311697a1e9"
server_key_iv: "bff9a8e293a6dd40ddccbd3c5d7baa52"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.360642 3047 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:00.361394 3061 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:00.361567 3047 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:00.361682 3047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "b5e1ee4851b246ad981430aa5274c69c"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "1d79914883301757b738e6311697a1e9"
server_key_iv: "bff9a8e293a6dd40ddccbd3c5d7baa52"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.361758 3047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:00.375950 3047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:00.376241 3047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:00.376398 3047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:00.380365 3047 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:39227
I20260806 15:08:00.380403 3114 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:39227 every 8 connection(s)
I20260806 15:08:00.380731 3047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:00.381386 3115 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:00.383950 3115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c: Bootstrap starting.
I20260806 15:08:00.384470 3115 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:00.384699 3115 log.cc:824] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:00.385304 3115 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c: No bootstrap required, opened a new log
I20260806 15:08:00.386849 3115 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5e1ee4851b246ad981430aa5274c69c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39227 } }
I20260806 15:08:00.386976 3115 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:00.386998 3115 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e1ee4851b246ad981430aa5274c69c, State: Initialized, Role: FOLLOWER
I20260806 15:08:00.387182 3115 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5e1ee4851b246ad981430aa5274c69c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39227 } }
I20260806 15:08:00.387295 3115 raft_consensus.cc:388] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:00.387323 3115 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:00.387360 3115 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:00.387866 3115 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5e1ee4851b246ad981430aa5274c69c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39227 } }
I20260806 15:08:00.387964 3115 leader_election.cc:302] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b5e1ee4851b246ad981430aa5274c69c; no voters:
I20260806 15:08:00.388115 3115 leader_election.cc:288] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:00.388136 3118 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:00.388290 3118 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [term 1 LEADER]: Becoming Leader. State: Replica: b5e1ee4851b246ad981430aa5274c69c, State: Running, Role: LEADER
I20260806 15:08:00.388290 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3047
I20260806 15:08:00.388379 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:00.388388 3115 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:00.388398 3118 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5e1ee4851b246ad981430aa5274c69c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39227 } }
I20260806 15:08:00.388581 29974 external_mini_cluster.cc:1428] Setting key 3753bb62a91a3d7d9d12cc1b3cbd8bc3
I20260806 15:08:00.388738 3118 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e1ee4851b246ad981430aa5274c69c. Latest consensus state: current_term: 1 leader_uuid: "b5e1ee4851b246ad981430aa5274c69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5e1ee4851b246ad981430aa5274c69c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39227 } } }
I20260806 15:08:00.388831 3118 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:00.388743 3120 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5e1ee4851b246ad981430aa5274c69c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b5e1ee4851b246ad981430aa5274c69c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39227 } } }
I20260806 15:08:00.388948 3120 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:00.389246 3124 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:00.389775 3124 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:00.391413 3124 catalog_manager.cc:1347] Generated new cluster ID: 5c9925ed0b024a3a90aaae0be1c28d3f
I20260806 15:08:00.391469 3124 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:00.394817 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:00.389176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52158 (local address 127.29.69.190:39227)
0806 15:08:00.389457 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:00.389465 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:00.389497 (+ 32us) server_negotiation.cc:407] Connection header received
0806 15:08:00.389627 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:00.389634 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:00.389704 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:00.390139 (+ 435us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:00.390248 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.391530 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.392660 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.393266 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.393376 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.394081 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:00.394086 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:00.394086 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:00.394275 (+ 189us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:00.394364 (+ 89us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:00.394379 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:00.394442 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:00.394544 (+ 102us) server_negotiation.cc:299] Negotiation successful
0806 15:08:00.394622 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":88,"threads_started":1}
I20260806 15:08:00.395638 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:08:00.407269 3124 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:00.407938 3124 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:00.420754 3124 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5e1ee4851b246ad981430aa5274c69c: Generated new TSK 0
I20260806 15:08:00.420938 3124 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:08:00.430156 3129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:00.426532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52172 (local address 127.29.69.190:39227)
0806 15:08:00.426592 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:00.426594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:00.426696 (+ 102us) server_negotiation.cc:407] Connection header received
0806 15:08:00.426738 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:00.426739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:00.426751 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:00.426830 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0806 15:08:00.426934 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.427727 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.428476 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.428811 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.428882 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.429037 (+ 155us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 15:08:00.429958 (+ 921us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42919/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 15:08:00.430089 (+ 131us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52172: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42919/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":37}
W20260806 15:08:00.430210 3129 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52172: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42919/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260806 15:08:00.432137 3145 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:00.426448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39227 (local address 127.0.0.1:52172)
0806 15:08:00.426632 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:00.426641 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:00.426692 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:00.426836 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:00.426837 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:00.426839 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 15:08:00.426888 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:00.426890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.427806 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.427806 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:00.428396 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:00.428398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.428896 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.428897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:00.428942 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.428946 (+ 4us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 15:08:00.430061 (+ 1115us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42919/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0806 15:08:00.432033 (+ 1972us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.69.190:39227: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42919/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":158,"mutex_wait_us":1755,"thread_start_us":110,"threads_started":1}
I20260806 15:08:00.432582 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3047
E20260806 15:08:00.443145 3146 webserver.cc:533] Webserver: sslize failed:
E20260806 15:08:00.443200 3146 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-06T15:08:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (217 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-06T15:08:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:00Z Disabled control of system clock
I20260806 15:08:00.479478 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:34429
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:39377
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:34429
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/testchainca.cert with env {}
W20260806 15:08:00.559827 3150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:00.560026 3150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:00.560048 3150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:00.561120 3150 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:00.561154 3150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:00.561167 3150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:00.561179 3150 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:00.561192 3150 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260806 15:08:00.561203 3150 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260806 15:08:00.561219 3150 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260806 15:08:00.562626 3150 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39377
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:34429
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:34429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:00.562867 3150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:00.563079 3150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:00.567821 3155 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:00.567848 3150 server_base.cc:1034] running on GCE node
W20260806 15:08:00.567857 3156 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:00.567821 3158 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:00.568264 3150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:00.568575 3150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:00.569725 3150 hybrid_clock.cc:648] HybridClock initialized: now 1786028880569716 us; error 32 us; skew 500 ppm
I20260806 15:08:00.570904 3150 webserver.cc:460] Webserver started at http://127.29.69.190:37737/ using document root <none> and password file <none>
I20260806 15:08:00.571172 3150 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:00.571220 3150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:00.571357 3150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:00.572446 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "376cce6e3e0e43138bba82e26c266052"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "a9908c60da4e40a274c9d5f932e80e4f"
server_key_iv: "2d66e19dd4a71220f942e75ba17b08cf"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.572902 3150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "376cce6e3e0e43138bba82e26c266052"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "a9908c60da4e40a274c9d5f932e80e4f"
server_key_iv: "2d66e19dd4a71220f942e75ba17b08cf"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.574271 3150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:08:00.575067 3165 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:00.575239 3150 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:00.575340 3150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "376cce6e3e0e43138bba82e26c266052"
format_stamp: "Formatted at 2026-08-06 15:08:00 on dist-test-slave-tm1g"
server_key: "a9908c60da4e40a274c9d5f932e80e4f"
server_key_iv: "2d66e19dd4a71220f942e75ba17b08cf"
server_key_version: "encryptionkey@0"
I20260806 15:08:00.575418 3150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:00.595520 3150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:00.595824 3150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:00.595971 3150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:00.599864 3150 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:34429
I20260806 15:08:00.599896 3217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:34429 every 8 connection(s)
I20260806 15:08:00.600234 3150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:00.601197 3218 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:00.603276 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3150
I20260806 15:08:00.603392 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:00.603575 29974 external_mini_cluster.cc:1428] Setting key 83baa64af0646a885ee3ffd318c22465
I20260806 15:08:00.603578 3218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052: Bootstrap starting.
I20260806 15:08:00.604288 3218 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:00.604588 3218 log.cc:824] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:00.605247 3218 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052: No bootstrap required, opened a new log
I20260806 15:08:00.607079 3218 raft_consensus.cc:348] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376cce6e3e0e43138bba82e26c266052" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34429 } }
I20260806 15:08:00.607204 3218 raft_consensus.cc:374] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:00.607226 3218 raft_consensus.cc:729] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 376cce6e3e0e43138bba82e26c266052, State: Initialized, Role: FOLLOWER
I20260806 15:08:00.607363 3218 consensus_queue.cc:260] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376cce6e3e0e43138bba82e26c266052" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34429 } }
I20260806 15:08:00.607439 3218 raft_consensus.cc:388] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:00.607481 3218 raft_consensus.cc:482] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:00.607529 3218 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:00.608155 3218 raft_consensus.cc:504] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376cce6e3e0e43138bba82e26c266052" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34429 } }
I20260806 15:08:00.608289 3218 leader_election.cc:302] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 376cce6e3e0e43138bba82e26c266052; no voters:
I20260806 15:08:00.608485 3218 leader_election.cc:288] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:00.608506 3223 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:00.608618 3223 raft_consensus.cc:686] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [term 1 LEADER]: Becoming Leader. State: Replica: 376cce6e3e0e43138bba82e26c266052, State: Running, Role: LEADER
I20260806 15:08:00.608700 3223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376cce6e3e0e43138bba82e26c266052" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34429 } }
I20260806 15:08:00.608739 3218 sys_catalog.cc:564] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:00.609010 3223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "376cce6e3e0e43138bba82e26c266052" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376cce6e3e0e43138bba82e26c266052" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34429 } } }
I20260806 15:08:00.609089 3223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:00.609212 3223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 376cce6e3e0e43138bba82e26c266052. Latest consensus state: current_term: 1 leader_uuid: "376cce6e3e0e43138bba82e26c266052" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "376cce6e3e0e43138bba82e26c266052" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34429 } } }
I20260806 15:08:00.609264 3223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:00.609376 3228 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:00.609963 3228 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:00.611402 3221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:00.604059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57972 (local address 127.29.69.190:34429)
0806 15:08:00.604283 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:00.604291 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:00.604343 (+ 52us) server_negotiation.cc:407] Connection header received
0806 15:08:00.604848 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:00.604855 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:00.604913 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:00.605060 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:00.605252 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.606169 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.606983 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.607565 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.607688 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.608438 (+ 750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:00.608442 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:00.608442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:00.608662 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:00.608706 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:00.608720 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:00.608790 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:00.608943 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 15:08:00.611171 (+ 2228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260806 15:08:00.612407 3241 mvcc.cc:205] Tried to move back new op lower bound from 7315574294983049216 to 7315574294973587456. Current Snapshot: MvccSnapshot[applied={T|T < 7315574294983049216}]
I20260806 15:08:00.618463 3228 catalog_manager.cc:1347] Generated new cluster ID: 7c0ba70589a642a1b8a6eca04761aba1
I20260806 15:08:00.618541 3228 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:00.618969 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:08:00.630538 3228 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:00.631335 3228 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:00.638893 3228 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 376cce6e3e0e43138bba82e26c266052: Generated new TSK 0
I20260806 15:08:00.639168 3228 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:08:00.722026 3221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:00.654023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57982 (local address 127.29.69.190:34429)
0806 15:08:00.654065 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:00.654067 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:00.654152 (+ 85us) server_negotiation.cc:407] Connection header received
0806 15:08:00.654231 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:00.654231 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:00.654243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:00.654323 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0806 15:08:00.654482 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.654978 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.655778 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.655999 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.656091 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.656280 (+ 189us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0806 15:08:00.721745 (+ 65465us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 15:08:00.721939 (+ 194us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57982: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 15:08:00.722143 3221 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57982: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260806 15:08:00.722218 3248 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:00.653970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34429 (local address 127.0.0.1:57982)
0806 15:08:00.654103 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:00.654112 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:00.654170 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:00.654325 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:00.654326 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:00.654328 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0806 15:08:00.654390 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:00.654392 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.655067 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.655068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:00.655707 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:00.655709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:00.656094 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:00.656095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:00.656157 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:00.656163 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0806 15:08:00.721901 (+ 65738us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0806 15:08:00.722100 (+ 199us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.29.69.190:34429: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":70,"threads_started":1}
I20260806 15:08:00.722623 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3150
2026-08-06T15:08:00Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (269 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (87 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:00 dist-test-slave-tm1g krb5kdc[3260](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:00 dist-test-slave-tm1g krb5kdc[3260](info): set up 2 sockets
Aug 06 15:08:00 dist-test-slave-tm1g krb5kdc[3260](info): commencing operation
krb5kdc: starting...
W20260806 15:08:01.938778 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:08:02.056653 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:39193
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:39193
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:02.136713 3274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:02.136941 3274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:02.136981 3274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:02.138136 3274 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:02.138203 3274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:02.138229 3274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:02.138259 3274 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:02.138279 3274 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:02.139751 3274 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:39193
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:39193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:02.140010 3274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:02.140228 3274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:02.144973 3280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.145025 3282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.145032 3279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:02.145221 3274 server_base.cc:1034] running on GCE node
I20260806 15:08:02.145637 3274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:02.145869 3274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:02.147001 3274 hybrid_clock.cc:648] HybridClock initialized: now 1786028882146980 us; error 36 us; skew 500 ppm
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.149474 3274 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:08:02.149847 3274 webserver.cc:460] Webserver started at http://127.29.69.190:38141/ using document root <none> and password file <none>
I20260806 15:08:02.150022 3274 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:02.150072 3274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:02.150168 3274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:02.151268 3274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "f74f6cbf6d484d62af99181662821912"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "99ce80373bd946c203ca32ff4b8bb012"
server_key_iv: "edcf19f08902d083f7345f64c098cbe7"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.151564 3274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "f74f6cbf6d484d62af99181662821912"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "99ce80373bd946c203ca32ff4b8bb012"
server_key_iv: "edcf19f08902d083f7345f64c098cbe7"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.152957 3274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:02.153650 3289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.153851 3274 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:02.153959 3274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "f74f6cbf6d484d62af99181662821912"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "99ce80373bd946c203ca32ff4b8bb012"
server_key_iv: "edcf19f08902d083f7345f64c098cbe7"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.154033 3274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:02.162115 3274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:02.163888 3274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:02.164047 3274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:02.167953 3274 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:39193
I20260806 15:08:02.167984 3347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:39193 every 8 connection(s)
I20260806 15:08:02.168320 3274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:02.169188 3348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:02.171032 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3274
I20260806 15:08:02.171130 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:02.171322 29974 external_mini_cluster.cc:1428] Setting key b3e4aa1d11f36ce829e018d561a19a38
I20260806 15:08:02.171717 3348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912: Bootstrap starting.
I20260806 15:08:02.172423 3348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:02.172766 3348 log.cc:824] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:02.173501 3348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912: No bootstrap required, opened a new log
I20260806 15:08:02.175314 3348 raft_consensus.cc:348] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74f6cbf6d484d62af99181662821912" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39193 } }
I20260806 15:08:02.175470 3348 raft_consensus.cc:374] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:02.175520 3348 raft_consensus.cc:729] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f74f6cbf6d484d62af99181662821912, State: Initialized, Role: FOLLOWER
I20260806 15:08:02.175657 3348 consensus_queue.cc:260] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74f6cbf6d484d62af99181662821912" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39193 } }
I20260806 15:08:02.175752 3348 raft_consensus.cc:388] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:02.175796 3348 raft_consensus.cc:482] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:02.175843 3348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:02.176383 3348 raft_consensus.cc:504] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74f6cbf6d484d62af99181662821912" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39193 } }
I20260806 15:08:02.176489 3348 leader_election.cc:302] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f74f6cbf6d484d62af99181662821912; no voters:
I20260806 15:08:02.176651 3348 leader_election.cc:288] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:02.176705 3353 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:02.176867 3353 raft_consensus.cc:686] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [term 1 LEADER]: Becoming Leader. State: Replica: f74f6cbf6d484d62af99181662821912, State: Running, Role: LEADER
I20260806 15:08:02.176908 3348 sys_catalog.cc:564] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:02.176965 3353 consensus_queue.cc:237] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74f6cbf6d484d62af99181662821912" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39193 } }
I20260806 15:08:02.177331 3353 sys_catalog.cc:455] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f74f6cbf6d484d62af99181662821912. Latest consensus state: current_term: 1 leader_uuid: "f74f6cbf6d484d62af99181662821912" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74f6cbf6d484d62af99181662821912" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39193 } } }
I20260806 15:08:02.177423 3353 sys_catalog.cc:458] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:02.177349 3354 sys_catalog.cc:455] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f74f6cbf6d484d62af99181662821912" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f74f6cbf6d484d62af99181662821912" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 39193 } } }
I20260806 15:08:02.177598 3354 sys_catalog.cc:458] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:02.178335 3362 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:02.178804 3362 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:02.180285 3362 catalog_manager.cc:1347] Generated new cluster ID: c37e8f40b2ed44afa2e58178a63df412
I20260806 15:08:02.180338 3362 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:02.184892 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.171843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54310 (local address 127.29.69.190:39193)
0806 15:08:02.172077 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.172088 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.172124 (+ 36us) server_negotiation.cc:407] Connection header received
0806 15:08:02.172729 (+ 605us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.172739 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.172798 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.172948 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.173693 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.174687 (+ 994us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.175424 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.176006 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.176134 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.179151 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.179155 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.179156 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.179168 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.183353 (+ 4185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.183729 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.183732 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.183732 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.183828 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.184041 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.184042 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.184042 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.184283 (+ 241us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.184475 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.184543 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.184685 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":79,"threads_started":1}
I20260806 15:08:02.188118 3362 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:02.188618 3362 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:02.200312 3362 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f74f6cbf6d484d62af99181662821912: Generated new TSK 0
I20260806 15:08:02.200510 3362 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:08:02.225101 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39193
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:02.305774 3376 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:02.306005 3376 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:02.306044 3376 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:02.307236 3376 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:02.307303 3376 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:02.307349 3376 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:02.308863 3376 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3376
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:02.309142 3376 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:02.309382 3376 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:02.314334 3382 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.314359 3385 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.314365 3383 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:02.314587 3376 server_base.cc:1034] running on GCE node
I20260806 15:08:02.314893 3376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:02.315152 3376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:02.316344 3376 hybrid_clock.cc:648] HybridClock initialized: now 1786028882316326 us; error 45 us; skew 500 ppm
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.318917 3376 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:08:02.319351 3376 webserver.cc:460] Webserver started at http://127.29.69.129:34233/ using document root <none> and password file <none>
I20260806 15:08:02.319610 3376 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:02.319679 3376 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:02.319823 3376 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:02.320842 3376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "2b38152ac7e04015a0ff023aebd9bffe"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "fb4241fd9db1042140d523b3f091db3f"
server_key_iv: "e899908d3049d763f5b1bffe463a644e"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.321194 3376 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "2b38152ac7e04015a0ff023aebd9bffe"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "fb4241fd9db1042140d523b3f091db3f"
server_key_iv: "e899908d3049d763f5b1bffe463a644e"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.322530 3376 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:08:02.323243 3393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.323416 3376 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:02.323522 3376 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "2b38152ac7e04015a0ff023aebd9bffe"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "fb4241fd9db1042140d523b3f091db3f"
server_key_iv: "e899908d3049d763f5b1bffe463a644e"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.323596 3376 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:02.335677 3376 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:02.337551 3376 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:02.337711 3376 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:02.337934 3376 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:02.338229 3376 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:02.338284 3376 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.338346 3376 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:02.338403 3376 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.344128 3376 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:40483
I20260806 15:08:02.344225 3512 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:40483 every 8 connection(s)
I20260806 15:08:02.344514 3376 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:02.349886 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3376
I20260806 15:08:02.350023 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:02.350222 29974 external_mini_cluster.cc:1428] Setting key d1686bd7b79b2e0b6aff0999dabbf115
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:02.354539 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.345216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:42349 (local address 127.29.69.190:39193)
0806 15:08:02.345261 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.345263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.345477 (+ 214us) server_negotiation.cc:407] Connection header received
0806 15:08:02.346456 (+ 979us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.346458 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.346471 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.346542 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.347236 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.347779 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.348773 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.348972 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.349022 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.351568 (+ 2546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.351569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.351569 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.351576 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.353022 (+ 1446us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.353520 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.353521 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.353521 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.353579 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.353849 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.353850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.353850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.353973 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.354051 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.354350 (+ 299us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.354445 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:08:02.354739 3515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.345160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39193 (local address 127.29.69.129:42349)
0806 15:08:02.345315 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:02.345367 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:02.346292 (+ 925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:02.346641 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:02.346645 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:02.346936 (+ 291us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:02.347127 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:02.347131 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.347873 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.347874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:02.348695 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:02.348697 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.349052 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.349053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:02.349176 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.349657 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:02.349665 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:02.351459 (+ 1794us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:02.353101 (+ 1642us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:02.353109 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:02.353112 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:02.353441 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:02.353653 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:02.353654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:02.353654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:02.353770 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:02.354043 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:02.354051 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:02.354195 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 15:08:02.354308 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 15:08:02.354504 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260806 15:08:02.355352 3513 heartbeater.cc:347] Connected to a master server at 127.29.69.190:39193
I20260806 15:08:02.355463 3513 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:02.355660 3513 heartbeater.cc:511] Master 127.29.69.190:39193 requested a full tablet report, sending...
I20260806 15:08:02.356227 3307 ts_manager.cc:194] Registered new tserver with Master: 2b38152ac7e04015a0ff023aebd9bffe (127.29.69.129:40483)
I20260806 15:08:02.356856 3307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:42349
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:08:02.375313 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39193
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:02.455615 3518 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:02.455854 3518 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:02.455893 3518 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:02.457175 3518 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:02.457237 3518 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:02.457283 3518 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:02.458824 3518 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3518
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:02.459095 3518 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:02.459326 3518 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:02.464319 3523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.464375 3526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.464344 3524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:02.464604 3518 server_base.cc:1034] running on GCE node
I20260806 15:08:02.464823 3518 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:02.465057 3518 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:02.466370 3518 hybrid_clock.cc:648] HybridClock initialized: now 1786028882466349 us; error 26 us; skew 500 ppm
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.468894 3518 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:08:02.469375 3518 webserver.cc:460] Webserver started at http://127.29.69.130:42421/ using document root <none> and password file <none>
I20260806 15:08:02.469606 3518 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:02.469674 3518 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:02.469820 3518 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:02.470935 3518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "128cc2f72d2a4123bacac8e43a925bdc"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "39babd5fa9b7800b362f3585107d2caf"
server_key_iv: "e4245b555668968d4ada0a41d2c33fe0"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.471294 3518 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "128cc2f72d2a4123bacac8e43a925bdc"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "39babd5fa9b7800b362f3585107d2caf"
server_key_iv: "e4245b555668968d4ada0a41d2c33fe0"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.472631 3518 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:02.473379 3533 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.473552 3518 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:02.473654 3518 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "128cc2f72d2a4123bacac8e43a925bdc"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "39babd5fa9b7800b362f3585107d2caf"
server_key_iv: "e4245b555668968d4ada0a41d2c33fe0"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.473734 3518 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:02.489089 3518 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:02.491016 3518 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:02.491183 3518 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:02.491423 3518 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:02.491731 3518 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:02.491784 3518 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.491827 3518 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:02.491853 3518 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.497609 3518 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:39067
I20260806 15:08:02.497660 3652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:39067 every 8 connection(s)
I20260806 15:08:02.497973 3518 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:02.499966 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3518
I20260806 15:08:02.500082 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:02.500263 29974 external_mini_cluster.cc:1428] Setting key 13909775839daa211c051faf3a570685
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:02.508365 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.498742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:59765 (local address 127.29.69.190:39193)
0806 15:08:02.498809 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.498811 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.499007 (+ 196us) server_negotiation.cc:407] Connection header received
0806 15:08:02.500016 (+ 1009us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.500017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.500056 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.500131 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.500936 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.501471 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.502645 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.502841 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.502899 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.505500 (+ 2601us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.505501 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.505502 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.505508 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.506905 (+ 1397us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.507395 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.507396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.507397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.507451 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.507748 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.507749 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.507749 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.507849 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.507898 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.508236 (+ 338us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.508300 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:08:02.508653 3655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.498713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39193 (local address 127.29.69.130:59765)
0806 15:08:02.498889 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:02.498925 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:02.499880 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:02.500240 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:02.500245 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:02.500571 (+ 326us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:02.500837 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:02.500843 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.501573 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.501574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:02.502561 (+ 987us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:02.502563 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.502929 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.502931 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:02.503092 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.503666 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:02.503674 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:02.505392 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:02.506993 (+ 1601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:02.507001 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:02.507003 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:02.507307 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:02.507533 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:02.507534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:02.507534 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:02.507678 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:02.507917 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:02.507925 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:02.508090 (+ 165us) client_negotiation.cc:769] Sending connection context
0806 15:08:02.508215 (+ 125us) client_negotiation.cc:240] Negotiation successful
0806 15:08:02.508387 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260806 15:08:02.509188 3653 heartbeater.cc:347] Connected to a master server at 127.29.69.190:39193
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
I20260806 15:08:02.509295 3653 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:02.509492 3653 heartbeater.cc:511] Master 127.29.69.190:39193 requested a full tablet report, sending...
I20260806 15:08:02.509884 3307 ts_manager.cc:194] Registered new tserver with Master: 128cc2f72d2a4123bacac8e43a925bdc (127.29.69.130:39067)
I20260806 15:08:02.510284 3307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:59765
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:08:02.525084 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39193
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41797
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:02.605788 3658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:02.606009 3658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:02.606050 3658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:02.607249 3658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:02.607312 3658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:02.607354 3658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:02.608812 3658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41797
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:39193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:02.609062 3658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:02.609282 3658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:02.614339 3663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:02.614476 3658 server_base.cc:1034] running on GCE node
W20260806 15:08:02.614269 3666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:02.614275 3664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:02.614784 3658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:02.615011 3658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:02.616174 3658 hybrid_clock.cc:648] HybridClock initialized: now 1786028882616162 us; error 30 us; skew 500 ppm
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.619015 3658 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:08:02.619460 3658 webserver.cc:460] Webserver started at http://127.29.69.131:35861/ using document root <none> and password file <none>
I20260806 15:08:02.619635 3658 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:02.619673 3658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:02.619761 3658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:02.620710 3658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "235692ddc817479581aa4055f30783dc"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "898535db1901afecb23d4cc635b9135b"
server_key_iv: "28eef036c489cbab93c6ae45adb8cc2e"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.621012 3658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "235692ddc817479581aa4055f30783dc"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "898535db1901afecb23d4cc635b9135b"
server_key_iv: "28eef036c489cbab93c6ae45adb8cc2e"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.622208 3658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:08:02.622956 3673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.623132 3658 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:02.623236 3658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "235692ddc817479581aa4055f30783dc"
format_stamp: "Formatted at 2026-08-06 15:08:02 on dist-test-slave-tm1g"
server_key: "898535db1901afecb23d4cc635b9135b"
server_key_iv: "28eef036c489cbab93c6ae45adb8cc2e"
server_key_version: "encryptionkey@0"
I20260806 15:08:02.623314 3658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:02.639040 3658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:02.641232 3658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:02.641397 3658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:02.641615 3658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:02.641914 3658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:02.641966 3658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.642005 3658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:02.642036 3658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:02.647680 3658 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:43723
I20260806 15:08:02.647735 3792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:43723 every 8 connection(s)
I20260806 15:08:02.648083 3658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:02.649495 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3658
I20260806 15:08:02.649569 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:02.649772 29974 external_mini_cluster.cc:1428] Setting key a3af1ff1332b85c6981766ec1f933971
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:02.657441 3351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.648820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:39465 (local address 127.29.69.190:39193)
0806 15:08:02.648890 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.648892 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.649094 (+ 202us) server_negotiation.cc:407] Connection header received
0806 15:08:02.650274 (+ 1180us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.650275 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.650287 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.650378 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.651109 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.651615 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.652563 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.652751 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.652807 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.654944 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.654945 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.654945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.654951 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.656100 (+ 1149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.656482 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.656483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.656483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.656537 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.656775 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.656776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.656776 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.656886 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.656937 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.657319 (+ 382us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.657379 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 15:08:02.657703 3795 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.648767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:39193 (local address 127.29.69.131:39465)
0806 15:08:02.648962 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:02.648999 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:02.650168 (+ 1169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:02.650444 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:02.650449 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:02.650829 (+ 380us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:02.651030 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:02.651035 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.651693 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.651694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:02.652484 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:02.652486 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.652832 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.652833 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:02.652954 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.653471 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:02.653479 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:02.654862 (+ 1383us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:02.656169 (+ 1307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:02.656175 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:02.656177 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:02.656418 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:02.656595 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:02.656595 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:02.656595 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:02.656691 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:02.656946 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:02.656951 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:02.657206 (+ 255us) client_negotiation.cc:769] Sending connection context
0806 15:08:02.657293 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 15:08:02.657452 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":66,"threads_started":1}
I20260806 15:08:02.658241 3793 heartbeater.cc:347] Connected to a master server at 127.29.69.190:39193
I20260806 15:08:02.658361 3793 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:02.658540 3793 heartbeater.cc:511] Master 127.29.69.190:39193 requested a full tablet report, sending...
I20260806 15:08:02.658901 3307 ts_manager.cc:194] Registered new tserver with Master: 235692ddc817479581aa4055f30783dc (127.29.69.131:43723)
I20260806 15:08:02.659235 3307 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:39465
I20260806 15:08:02.661545 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/test-admin.keytab.
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.678500 29974 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260806 15:08:02.680008 3800 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:02.679294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39208 (local address 127.29.69.129:40483)
0806 15:08:02.679459 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.679464 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.679474 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:08:02.679498 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.679500 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.679513 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.679578 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.679897 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39208: BlockingRecv error: recv got EOF from 127.0.0.1:39208 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
W20260806 15:08:02.680105 29974 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc' of type FILE
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.681084 29974 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.681957 29974 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:08:02.689606 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.682515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39210 (local address 127.29.69.129:40483)
0806 15:08:02.682570 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.682572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.682630 (+ 58us) server_negotiation.cc:407] Connection header received
0806 15:08:02.682706 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.682707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.682718 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.682790 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.683187 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.683903 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.684656 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.684997 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.685084 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.687158 (+ 2074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.687165 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.687165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.687171 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.688538 (+ 1367us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.688849 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.688851 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.688851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.688909 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.689078 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.689079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.689079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.689200 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.689292 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.689366 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.689469 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
W20260806 15:08:02.691323 3800 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:02.690820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39226 (local address 127.29.69.129:40483)
0806 15:08:02.690872 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.690874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.690917 (+ 43us) server_negotiation.cc:407] Connection header received
0806 15:08:02.690956 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.690957 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.690964 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.691010 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.691256 (+ 246us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39226: BlockingRecv error: recv got EOF from 127.0.0.1:39226 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260806 15:08:02.691473 29974 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc' of type FILE
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.692499 29974 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.693374 29974 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:08:02.699962 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.693854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39230 (local address 127.29.69.129:40483)
0806 15:08:02.693916 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.693918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.693926 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:02.693975 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.693975 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.693983 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.694027 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.694403 (+ 376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.694862 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.695502 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.695691 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.695744 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.697648 (+ 1904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.697649 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.697650 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.697657 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.698869 (+ 1212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.699227 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.699228 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.699229 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.699285 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.699490 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.699491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.699491 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.699586 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.699683 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.699784 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.699858 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260806 15:08:02.701522 3800 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:02.700968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39238 (local address 127.29.69.129:40483)
0806 15:08:02.701041 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.701047 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.701056 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:08:02.701108 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.701108 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.701115 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.701164 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.701451 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39238: BlockingRecv error: recv got EOF from 127.0.0.1:39238 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
W20260806 15:08:02.701658 29974 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc' of type FILE: Runtime error: End of credential cache reached (filename: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786028857624334-29974-0/krb5kdc/krb5cc)
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.702606 29974 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:02.703421 29974 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028882, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:08:02.709738 3800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:02.703908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39244 (local address 127.29.69.129:40483)
0806 15:08:02.703968 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:02.703970 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:02.704023 (+ 53us) server_negotiation.cc:407] Connection header received
0806 15:08:02.704085 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:02.704086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:02.704095 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:02.704164 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:02.704510 (+ 346us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.704977 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.705660 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:02.705847 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:02.705916 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:02.707836 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:02.707837 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:02.707837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:02.707843 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:02.708945 (+ 1102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.709230 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.709231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.709231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.709279 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:02.709420 (+ 141us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:02.709421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:02.709421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:02.709491 (+ 70us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:02.709549 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:02.709635 (+ 86us) server_negotiation.cc:299] Negotiation successful
0806 15:08:02.709686 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:08:02.710346 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3376
I20260806 15:08:02.715507 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3518
I20260806 15:08:02.720319 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3658
I20260806 15:08:02.725179 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3274
2026-08-06T15:08:02Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1828 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3813](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3813](info): set up 2 sockets
Aug 06 15:08:02 dist-test-slave-tm1g krb5kdc[3813](info): commencing operation
krb5kdc: starting...
W20260806 15:08:03.764114 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.018s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:03 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:03Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab.
Entry for principal oryx/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab.
I20260806 15:08:03.881474 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46287
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab
--principal=oryx/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46287
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:03.960440 3826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:03.960682 3826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:03.960719 3826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:03.961846 3826 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:03.961917 3826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:03.961942 3826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:03.961972 3826 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:03.962004 3826 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:03.963462 3826 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46287
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab
--principal=oryx/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:03.963732 3826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:03.963958 3826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:03.968755 3834 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:03.968814 3831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:03.968855 3826 server_base.cc:1034] running on GCE node
W20260806 15:08:03.968757 3832 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:03.969246 3826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:03.969538 3826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:03.970679 3826 hybrid_clock.cc:648] HybridClock initialized: now 1786028883970655 us; error 36 us; skew 500 ppm
Aug 06 15:08:03 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:03.976086 3826 init.cc:377] Logged in from keytab as oryx/127.29.69.190@KRBTEST.COM (short username oryx)
I20260806 15:08:03.976456 3826 webserver.cc:460] Webserver started at http://127.29.69.190:41533/ using document root <none> and password file <none>
I20260806 15:08:03.976625 3826 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:03.976663 3826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:03.976747 3826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:03.977694 3826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "e9ba2c64bce64496b9ee66d3b9f0382b"
format_stamp: "Formatted at 2026-08-06 15:08:03 on dist-test-slave-tm1g"
server_key: "713963aabe968256917821ce194088e0"
server_key_iv: "8de9d623c481981655f36b137826e38c"
server_key_version: "encryptionkey@0"
I20260806 15:08:03.977983 3826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "e9ba2c64bce64496b9ee66d3b9f0382b"
format_stamp: "Formatted at 2026-08-06 15:08:03 on dist-test-slave-tm1g"
server_key: "713963aabe968256917821ce194088e0"
server_key_iv: "8de9d623c481981655f36b137826e38c"
server_key_version: "encryptionkey@0"
I20260806 15:08:03.979296 3826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:03.979981 3841 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:03.980154 3826 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:03.980261 3826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "e9ba2c64bce64496b9ee66d3b9f0382b"
format_stamp: "Formatted at 2026-08-06 15:08:03 on dist-test-slave-tm1g"
server_key: "713963aabe968256917821ce194088e0"
server_key_iv: "8de9d623c481981655f36b137826e38c"
server_key_version: "encryptionkey@0"
I20260806 15:08:03.980334 3826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.000092 3826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.002027 3826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:04.002218 3826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.006268 3826 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:46287
I20260806 15:08:04.006342 3893 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:46287 every 8 connection(s)
I20260806 15:08:04.006738 3826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:04.007731 3894 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:04.009984 3894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Bootstrap starting.
I20260806 15:08:04.010620 3894 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:04.010869 3894 log.cc:824] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:04.011528 3894 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: No bootstrap required, opened a new log
I20260806 15:08:04.013093 3894 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } }
I20260806 15:08:04.013233 3894 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:04.013257 3894 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9ba2c64bce64496b9ee66d3b9f0382b, State: Initialized, Role: FOLLOWER
I20260806 15:08:04.013358 3894 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } }
I20260806 15:08:04.013438 3894 raft_consensus.cc:388] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:04.013473 3894 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:04.013530 3894 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:04.014449 3894 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } }
I20260806 15:08:04.014592 3894 leader_election.cc:302] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e9ba2c64bce64496b9ee66d3b9f0382b; no voters:
I20260806 15:08:04.014765 3894 leader_election.cc:288] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:04.014842 3897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:04.015035 3897 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 LEADER]: Becoming Leader. State: Replica: e9ba2c64bce64496b9ee66d3b9f0382b, State: Running, Role: LEADER
I20260806 15:08:04.015062 3894 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:04.015131 3897 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } }
I20260806 15:08:04.015503 3898 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } }
I20260806 15:08:04.015519 3899 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ba2c64bce64496b9ee66d3b9f0382b. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } }
I20260806 15:08:04.015717 3899 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:04.015802 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3826
I20260806 15:08:04.015914 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:04.015885 3898 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:04.016109 29974 external_mini_cluster.cc:1428] Setting key 5b13498094bca87cbb520be4336aa2ca
I20260806 15:08:04.016716 3907 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:04.017215 3907 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:04.018913 3907 catalog_manager.cc:1347] Generated new cluster ID: a1951d064150421e97e8733849ab84ea
I20260806 15:08:04.018970 3907 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:04.023157 3907 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:04.023633 3907 catalog_manager.cc:1504] Loading token signing keys...
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:04.027369 3907 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Generated new TSK 0
I20260806 15:08:04.027527 3907 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:08:04.028494 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.016732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58356 (local address 127.29.69.190:46287)
0806 15:08:04.016969 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.016981 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.017017 (+ 36us) server_negotiation.cc:407] Connection header received
0806 15:08:04.017135 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.017141 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.017221 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.018161 (+ 940us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.018256 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.019668 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.020790 (+ 1122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.021392 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.021490 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.024411 (+ 2921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.024415 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.024415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.024426 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.026864 (+ 2438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.027280 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.027283 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.027284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.027397 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.027650 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.027651 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.027652 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.027879 (+ 227us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.028034 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.028146 (+ 112us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.028299 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for oryx/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab.
Entry for principal oryx/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab.
I20260806 15:08:04.052851 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46287
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:04.133538 3923 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:04.133730 3923 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:04.133754 3923 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:04.134900 3923 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:04.134938 3923 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:04.134963 3923 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:04.136381 3923 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3923
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:04.136636 3923 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:04.136865 3923 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:04.141774 3932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.141829 3929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.141815 3928 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.142211 3923 server_base.cc:1034] running on GCE node
I20260806 15:08:04.142452 3923 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:04.142705 3923 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:04.143850 3923 hybrid_clock.cc:648] HybridClock initialized: now 1786028884143843 us; error 30 us; skew 500 ppm
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:04.146286 3923 init.cc:377] Logged in from keytab as oryx/127.29.69.129@KRBTEST.COM (short username oryx)
I20260806 15:08:04.146754 3923 webserver.cc:460] Webserver started at http://127.29.69.129:39529/ using document root <none> and password file <none>
I20260806 15:08:04.147038 3923 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.147126 3923 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.147274 3923 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:04.148303 3923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "a4dbb895b58a4130807ca10cd207efc8"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c1206e2f8232972800584b9d4657d937"
server_key_iv: "0f17a949eaee52af89777da3d803b9ca"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.148669 3923 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "a4dbb895b58a4130807ca10cd207efc8"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c1206e2f8232972800584b9d4657d937"
server_key_iv: "0f17a949eaee52af89777da3d803b9ca"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.150018 3923 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 15:08:04.150835 3939 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.151018 3923 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.151124 3923 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "a4dbb895b58a4130807ca10cd207efc8"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c1206e2f8232972800584b9d4657d937"
server_key_iv: "0f17a949eaee52af89777da3d803b9ca"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.151211 3923 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.176223 3923 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.178229 3923 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:04.178417 3923 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.178651 3923 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:04.179029 3923 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:04.179093 3923 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.179133 3923 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:04.179160 3923 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.185151 3923 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:38687
I20260806 15:08:04.185205 4053 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:38687 every 8 connection(s)
I20260806 15:08:04.185518 3923 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:04.187568 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 3923
I20260806 15:08:04.187680 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:04.187892 29974 external_mini_cluster.cc:1428] Setting key eb0a4405a818bd022a7261b76c7df31d
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:04.196384 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.186225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:43797 (local address 127.29.69.190:46287)
0806 15:08:04.186290 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.186293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.186502 (+ 209us) server_negotiation.cc:407] Connection header received
0806 15:08:04.186961 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.186962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.186971 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.187032 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.188243 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.188843 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.190390 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.190719 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.190790 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.193311 (+ 2521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.193312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.193313 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.193321 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.194983 (+ 1662us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.195364 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.195365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.195366 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.195440 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.195680 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.195681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.195682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.195837 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.195915 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.196183 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.196286 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:08:04.196403 4056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.186181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:43797)
0806 15:08:04.186372 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.186413 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.186881 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.187091 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.187095 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.187835 (+ 740us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.188122 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.188128 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.188939 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.188940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.190274 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.190277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.190811 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.190812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.190912 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.191430 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.191439 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.193217 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.195065 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.195072 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.195073 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.195287 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.195513 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.195514 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.195514 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.195610 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.195915 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.195922 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.196042 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.196129 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.196246 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":97,"threads_started":1}
I20260806 15:08:04.196982 4054 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46287
I20260806 15:08:04.197088 4054 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:04.197257 4054 heartbeater.cc:511] Master 127.29.69.190:46287 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.29.69.130@KRBTEST.COM; defaulting to no policy
I20260806 15:08:04.197863 3858 ts_manager.cc:194] Registered new tserver with Master: a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129:38687)
I20260806 15:08:04.198545 3858 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:43797
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab.
Entry for principal oryx/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab.
I20260806 15:08:04.212757 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46287
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:04.293866 4060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:04.294067 4060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:04.294098 4060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:04.295311 4060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:04.295356 4060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:04.295382 4060 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:04.296916 4060 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:04.297152 4060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:04.297397 4060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:04.302345 4065 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.302356 4069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.302464 4066 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.302676 4060 server_base.cc:1034] running on GCE node
I20260806 15:08:04.302886 4060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:04.303165 4060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:04.304306 4060 hybrid_clock.cc:648] HybridClock initialized: now 1786028884304296 us; error 26 us; skew 500 ppm
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:04.306829 4060 init.cc:377] Logged in from keytab as oryx/127.29.69.130@KRBTEST.COM (short username oryx)
I20260806 15:08:04.307320 4060 webserver.cc:460] Webserver started at http://127.29.69.130:46073/ using document root <none> and password file <none>
I20260806 15:08:04.307551 4060 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.307622 4060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.307813 4060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:04.308851 4060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "a1d73c25e8f24b269c38185695dbfd6e"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "e9b4b1db1182e21fc36323064489571d"
server_key_iv: "1b1731a608be3c91a89af9d177e8588a"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.309230 4060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "a1d73c25e8f24b269c38185695dbfd6e"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "e9b4b1db1182e21fc36323064489571d"
server_key_iv: "1b1731a608be3c91a89af9d177e8588a"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.310668 4060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:04.311427 4076 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.311599 4060 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:04.311705 4060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "a1d73c25e8f24b269c38185695dbfd6e"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "e9b4b1db1182e21fc36323064489571d"
server_key_iv: "1b1731a608be3c91a89af9d177e8588a"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.311779 4060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.319290 4060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.321044 4060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:04.321204 4060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.321420 4060 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:04.321720 4060 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:04.321775 4060 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.321815 4060 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:04.321842 4060 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.327849 4060 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:38231
I20260806 15:08:04.327903 4190 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:38231 every 8 connection(s)
I20260806 15:08:04.328207 4060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:04.336817 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.328920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:40849 (local address 127.29.69.190:46287)
0806 15:08:04.328985 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.328988 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.329165 (+ 177us) server_negotiation.cc:407] Connection header received
0806 15:08:04.329631 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.329632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.329642 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.329686 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.330621 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.331112 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.332027 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.332206 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.332256 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.334224 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.334226 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.334226 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.334233 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.335646 (+ 1413us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.336026 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.336028 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.336028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.336096 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.336314 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.336314 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.336315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.336419 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.336471 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.336689 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.336753 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:08:04.336962 4193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.328874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:40849)
0806 15:08:04.329027 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.329068 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.329536 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.329737 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.329740 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.330283 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.330547 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.330551 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.331190 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.331190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.331955 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.331957 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.332276 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.332277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.332372 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.332785 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.332792 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.334137 (+ 1345us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.335722 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.335728 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.335730 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.335943 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.336159 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.336160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.336160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.336256 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.336472 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.336476 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.336581 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.336662 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.336776 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
I20260806 15:08:04.337118 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4060
I20260806 15:08:04.337212 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:04.337368 29974 external_mini_cluster.cc:1428] Setting key c39e9bf13ba8c835e949092c6ea37d37
I20260806 15:08:04.337499 4191 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46287
I20260806 15:08:04.337594 4191 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:04.337766 4191 heartbeater.cc:511] Master 127.29.69.190:46287 requested a full tablet report, sending...
I20260806 15:08:04.338156 3858 ts_manager.cc:194] Registered new tserver with Master: a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231)
I20260806 15:08:04.338575 3858 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:40849
WARNING: no policy specified for oryx/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab.
Entry for principal oryx/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab.
I20260806 15:08:04.361145 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46287
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:04.441409 4196 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:04.441648 4196 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:04.441689 4196 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:04.442858 4196 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:04.442925 4196 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:04.442974 4196 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:04.444474 4196 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46287
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4196
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:04.444736 4196 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:04.444996 4196 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:04.449932 4205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.450001 4202 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.449985 4196 server_base.cc:1034] running on GCE node
W20260806 15:08:04.449947 4203 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.450438 4196 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:04.450688 4196 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:04.451853 4196 hybrid_clock.cc:648] HybridClock initialized: now 1786028884451838 us; error 27 us; skew 500 ppm
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:04.454397 4196 init.cc:377] Logged in from keytab as oryx/127.29.69.131@KRBTEST.COM (short username oryx)
I20260806 15:08:04.454806 4196 webserver.cc:460] Webserver started at http://127.29.69.131:37447/ using document root <none> and password file <none>
I20260806 15:08:04.454988 4196 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.455027 4196 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.455124 4196 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:04.456067 4196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "de0b9952227e4b0f82502b9b07dc61aa"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "30e36a96a8efd9c596385faab5e5bd19"
server_key_iv: "f8b8af5d8ff7cd2d0a839dfe159d67f2"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.456377 4196 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "de0b9952227e4b0f82502b9b07dc61aa"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "30e36a96a8efd9c596385faab5e5bd19"
server_key_iv: "f8b8af5d8ff7cd2d0a839dfe159d67f2"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.457774 4196 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:04.458529 4213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.458741 4196 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:04.458818 4196 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "de0b9952227e4b0f82502b9b07dc61aa"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "30e36a96a8efd9c596385faab5e5bd19"
server_key_iv: "f8b8af5d8ff7cd2d0a839dfe159d67f2"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.458904 4196 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.469143 4196 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.471450 4196 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:04.471607 4196 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.471841 4196 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:04.472149 4196 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:04.472183 4196 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.472236 4196 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:04.472265 4196 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.477766 4196 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:41331
I20260806 15:08:04.477842 4328 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:41331 every 8 connection(s)
I20260806 15:08:04.478137 4196 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:04.485549 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4196
I20260806 15:08:04.485643 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:04.485841 29974 external_mini_cluster.cc:1428] Setting key 1ac940bc82c5f3efbc1275809fcf9733
I20260806 15:08:04.487272 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.478859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:59541 (local address 127.29.69.190:46287)
0806 15:08:04.478915 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.478917 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.479103 (+ 186us) server_negotiation.cc:407] Connection header received
0806 15:08:04.479555 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.479556 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.479566 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.479617 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.480544 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.481040 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.481966 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.482150 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.482198 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.484309 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.484310 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.484310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.484317 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.485914 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.486387 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.486388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.486388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.486448 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.486729 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.486730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.486731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.486868 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.486938 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.487151 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.487209 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:08:04.487504 4331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.478837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:59541)
0806 15:08:04.478984 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.479018 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.479472 (+ 454us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.479665 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.479668 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.480286 (+ 618us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.480466 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.480471 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.481117 (+ 646us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.481118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.481892 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.481894 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.482219 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.482220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.482399 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.482806 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.482814 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.484222 (+ 1408us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.485995 (+ 1773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.486003 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.486005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.486282 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.486525 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.486526 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.486526 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.486659 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.486935 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.486940 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.487049 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.487138 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.487255 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260806 15:08:04.487905 4329 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46287
I20260806 15:08:04.488019 4329 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:04.488188 4329 heartbeater.cc:511] Master 127.29.69.190:46287 requested a full tablet report, sending...
I20260806 15:08:04.488538 3858 ts_manager.cc:194] Registered new tserver with Master: de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:04.488864 3858 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:59541
I20260806 15:08:04.497529 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.69.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.189.keytab.
Entry for principal oryx/127.29.69.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.189.keytab.
I20260806 15:08:04.520669 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:43385
--webserver_interface=127.29.69.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.189.keytab
--principal=oryx/127.29.69.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46287,127.29.69.189:43385
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:04.600083 4334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:04.600318 4334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:04.600354 4334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:04.601466 4334 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:04.601539 4334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:04.601565 4334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:04.601605 4334 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:04.601630 4334 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:04.603201 4334 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46287,127.29.69.189:43385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.189.keytab
--principal=oryx/127.29.69.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:43385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.69.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
W20260806 15:08:04.603332 4334 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.29.69.190:46287,127.29.69.189:43385'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260806 15:08:04.603497 4334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:04.603775 4334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:04.609244 4339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.609246 4340 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.609305 4342 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.609707 4334 server_base.cc:1034] running on GCE node
I20260806 15:08:04.609961 4334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:04.610250 4334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:04.611426 4334 hybrid_clock.cc:648] HybridClock initialized: now 1786028884611415 us; error 27 us; skew 500 ppm
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:04.613744 4334 init.cc:377] Logged in from keytab as oryx/127.29.69.189@KRBTEST.COM (short username oryx)
I20260806 15:08:04.614205 4334 webserver.cc:460] Webserver started at http://127.29.69.189:42789/ using document root <none> and password file <none>
I20260806 15:08:04.614454 4334 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.614523 4334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.614715 4334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:04.615828 4334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/instance:
uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c81b2c7c5d96d68bd2ada78a8de817bc"
server_key_iv: "e2cde4186b4c121633c45dfc45b36410"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.616253 4334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal/instance:
uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c81b2c7c5d96d68bd2ada78a8de817bc"
server_key_iv: "e2cde4186b4c121633c45dfc45b36410"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.617674 4334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:04.618391 4350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.618575 4334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:04.618676 4334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c81b2c7c5d96d68bd2ada78a8de817bc"
server_key_iv: "e2cde4186b4c121633c45dfc45b36410"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.618764 4334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.639707 4334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.641644 4334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:04.641803 4334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.647689 4334 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.189:43385
I20260806 15:08:04.647733 4404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.189:43385 every 8 connection(s)
I20260806 15:08:04.648223 4334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
I20260806 15:08:04.649510 4405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:04.652320 4405 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:08:04.654729 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4334
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.189@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
I20260806 15:08:04.663012 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.653099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58368 (local address 127.29.69.190:46287)
0806 15:08:04.653147 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.653150 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.653472 (+ 322us) server_negotiation.cc:407] Connection header received
0806 15:08:04.654229 (+ 757us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.654231 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.654243 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.654351 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.655249 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.655804 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.656800 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.657027 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.657105 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.659691 (+ 2586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.659692 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.659693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.659701 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.661276 (+ 1575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.661907 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.661908 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.661908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.661963 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.662225 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.662225 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.662226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.662420 (+ 194us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.662475 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.662820 (+ 345us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.662907 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:08:04.663180 4407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.653047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58368)
0806 15:08:04.653307 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.653376 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.654119 (+ 743us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.654403 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.654407 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.654713 (+ 306us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.655105 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.655110 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.655919 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.655920 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.656700 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.656701 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.657115 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.657116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.657313 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.657882 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.657898 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.659592 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.661371 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.661377 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.661379 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.661820 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.662028 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.662029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.662029 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.662154 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.662485 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.662537 (+ 52us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.662691 (+ 154us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.662774 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.662917 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":90,"threads_started":1}
I20260806 15:08:04.663787 4409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.655207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35622 (local address 127.29.69.189:43385)
0806 15:08:04.655395 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.655400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.655421 (+ 21us) server_negotiation.cc:407] Connection header received
0806 15:08:04.655448 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.655450 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.655465 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.655545 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.656110 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.656839 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.657690 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.657998 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.658084 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.660617 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.660626 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.660626 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.660633 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.662478 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.662899 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.662901 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.662902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.662958 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.663200 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.663201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.663201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.663403 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.663532 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.663640 (+ 108us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.663719 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":110,"threads_started":1}
I20260806 15:08:04.663764 4405 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.189@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
I20260806 15:08:04.670006 4407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.664059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35638)
0806 15:08:04.664090 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.664099 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.664142 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.664252 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.664253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.664401 (+ 148us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.664455 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.664457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.665036 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.665037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.665504 (+ 467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.665505 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.665882 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.665882 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.665946 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.666353 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.666358 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.667401 (+ 1043us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.668930 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.668931 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.668931 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.669094 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.669301 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.669302 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.669302 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.669355 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.669593 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.669593 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.669630 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.669707 (+ 77us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.669801 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260806 15:08:04.670054 4409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.664094 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35638 (local address 127.29.69.189:43385)
0806 15:08:04.664127 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.664129 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.664137 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:04.664181 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.664182 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.664191 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.664250 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.664519 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.664957 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.665582 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.665798 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.665881 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.667490 (+ 1609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.667491 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.667492 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.667498 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.668828 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.669174 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.669175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.669175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.669230 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.669420 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.669420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.669421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.669524 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.669595 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.669727 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.669850 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":63,"server-negotiator.queue_time_us":18}
I20260806 15:08:04.671216 4405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Bootstrap starting.
I20260806 15:08:04.672053 4405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:04.672346 4405 log.cc:824] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:04.672991 4405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: No bootstrap required, opened a new log
I20260806 15:08:04.674432 4405 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } }
I20260806 15:08:04.674544 4405 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:04.674566 4405 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7abb0686e3468eb5a1dd8edb83ea60, State: Initialized, Role: FOLLOWER
I20260806 15:08:04.674714 4405 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } }
I20260806 15:08:04.674990 4405 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:04.674965 4411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } } }
I20260806 15:08:04.675093 4411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:08:04.676697 4422 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:08:04.676759 4422 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:08:04.678236 4334 master_runner.cc:428] Detected that this master 3d7abb0686e3468eb5a1dd8edb83ea60 is joining an existing cluster
I20260806 15:08:04.678363 4334 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.69.189:43385
I20260806 15:08:04.686604 4429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.679609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35652)
0806 15:08:04.679733 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.679742 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.679802 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.679921 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.679922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.680175 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.680238 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.680240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.681100 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.681101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.681977 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.681979 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.682348 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.682349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.682413 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.682864 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.682869 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.683268 (+ 399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.685133 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.685134 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.685135 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.685655 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.685887 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.685888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.685888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.685950 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.686220 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.686221 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.686266 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.686370 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.686469 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260806 15:08:04.686698 4409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.679672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35652 (local address 127.29.69.189:43385)
0806 15:08:04.679714 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.679716 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.679792 (+ 76us) server_negotiation.cc:407] Connection header received
0806 15:08:04.679848 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.679849 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.679857 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.679909 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.680329 (+ 420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.681018 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.682060 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.682233 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.682336 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.683358 (+ 1022us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.683359 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.683359 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.683367 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.685046 (+ 1679us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.685740 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.685741 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.685741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.685803 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.686018 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.686019 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.686019 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.686142 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.686213 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.686415 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.686567 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":20}
I20260806 15:08:04.687170 4411 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:04.687251 4411 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } }
I20260806 15:08:04.687439 4411 leader_election.cc:288] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287)
I20260806 15:08:04.687676 3868 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" is_pre_election: true
I20260806 15:08:04.687827 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.679725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58382 (local address 127.29.69.190:46287)
0806 15:08:04.679767 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.679769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.679776 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:04.679797 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.679798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.679808 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.679857 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.680281 (+ 424us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.681018 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.683055 (+ 2037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.683361 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.683429 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.684556 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.684557 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.684557 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.684564 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.686233 (+ 1669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.686672 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.686673 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.686673 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.686735 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.687153 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.687155 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.687155 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.687297 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.687366 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.687579 (+ 213us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.687660 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:08:04.687907 4428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.679388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58382)
0806 15:08:04.679523 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.679534 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.679582 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.679913 (+ 331us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.679914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.680125 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.680199 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.680201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.682081 (+ 1880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.682082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.682968 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.682971 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.683430 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.683430 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.683497 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.683997 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.684003 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.684452 (+ 449us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.686292 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.686292 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.686293 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.686577 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.687016 (+ 439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.687017 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.687017 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.687079 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.687395 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.687396 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.687449 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.687698 (+ 249us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.687796 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
I20260806 15:08:04.688083 4352 leader_election.cc:302] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: 3d7abb0686e3468eb5a1dd8edb83ea60; no voters: e9ba2c64bce64496b9ee66d3b9f0382b
I20260806 15:08:04.688280 4411 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.190@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
I20260806 15:08:04.697378 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.690277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35658)
0806 15:08:04.690466 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.690505 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.690580 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.690713 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.690716 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.691040 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.691097 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.691099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.691658 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.691659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.692576 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.692578 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.692895 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.692897 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.692977 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.693376 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.693381 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.694808 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.696327 (+ 1519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.696334 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.696336 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.696556 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.696819 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.696819 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.696820 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.696876 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.697124 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.697130 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.697169 (+ 39us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.697230 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.697314 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":114,"threads_started":1}
I20260806 15:08:04.697438 4409 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.690367 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35658 (local address 127.29.69.189:43385)
0806 15:08:04.690404 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.690406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.690572 (+ 166us) server_negotiation.cc:407] Connection header received
0806 15:08:04.690651 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.690651 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.690659 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.690699 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.691167 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.691582 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.692655 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.692818 (+ 163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.692864 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.694897 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.694898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.694898 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.694905 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.696225 (+ 1320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.696680 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.696681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.696681 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.696743 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.696939 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.696940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.696940 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.697062 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.697127 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.697273 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.697352 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:08:04.698082 3858 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.69.189:43385: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
member_type: NON_VOTER
last_known_addr {
host: "127.29.69.189"
port: 43385
}
attrs {
promote: true
}
}
dest_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b"
cas_config_opid_index: -1
I20260806 15:08:04.698426 3858 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } }
I20260806 15:08:04.698891 4432 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } }
I20260806 15:08:04.699159 4378 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:04.699893 4378 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Refusing update from remote peer e9ba2c64bce64496b9ee66d3b9f0382b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260806 15:08:04.699932 4432 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.69.189:43385
I20260806 15:08:04.700008 4432 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } }
I20260806 15:08:04.700062 4432 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:04.700176 4431 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:04.700210 4334 master.cc:537] Master@127.29.69.189:43385 shutting down...
W20260806 15:08:04.701076 3843 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260806 15:08:04.701467 3843 consensus_peers.cc:487] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b -> Peer 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189:43385): Couldn't send request to peer 3d7abb0686e3468eb5a1dd8edb83ea60. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 15:08:04.702960 4334 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:04.703045 4334 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:04.703111 4334 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: stopping tablet replica
I20260806 15:08:04.705495 4334 master.cc:552] Master@127.29.69.189:43385 shutdown complete.
I20260806 15:08:04.705538 4334 master_runner.cc:305] Clearing existing system tablet
I20260806 15:08:04.705681 4334 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.705727 4334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.706382 4334 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:04.706872 4436 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.706991 4334 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.707046 4334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.707067 4334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c81b2c7c5d96d68bd2ada78a8de817bc"
server_key_iv: "e2cde4186b4c121633c45dfc45b36410"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.707630 4334 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:04.708904 4334 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 15:08:04.708959 4334 log.cc:1196] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260806 15:08:04.709158 4334 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Deleting consensus metadata
I20260806 15:08:04.709295 4334 master_runner.cc:315] Copying system tablet from 127.29.69.190:46287
I20260806 15:08:04.709889 4334 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: tablet copy: Beginning tablet copy session from remote peer at address 127.29.69.190:46287
I20260806 15:08:04.715910 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.710202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58398 (local address 127.29.69.190:46287)
0806 15:08:04.710239 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.710241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.710345 (+ 104us) server_negotiation.cc:407] Connection header received
0806 15:08:04.710418 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.710419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.710429 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.710483 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.710771 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.711248 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.711954 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.712164 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.712239 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.713142 (+ 903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.713143 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.713144 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.713150 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.714656 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.715130 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.715131 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.715131 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.715190 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.715387 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.715388 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.715388 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.715497 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.715570 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.715746 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.715826 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:08:04.715925 4442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.710152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58398)
0806 15:08:04.710265 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.710275 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.710361 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.710488 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.710489 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.710653 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.710694 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.710696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.711334 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.711335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.711869 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.711870 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.712238 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.712239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.712303 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.712754 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.712759 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.713035 (+ 276us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.714741 (+ 1706us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.714742 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.714743 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.715037 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.715255 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.715256 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.715256 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.715315 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.715572 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.715573 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.715616 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.715720 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.715821 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":65,"threads_started":1}
I20260806 15:08:04.716200 3878 tablet_copy_service.cc:140] P e9ba2c64bce64496b9ee66d3b9f0382b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 3d7abb0686e3468eb5a1dd8edb83ea60 ({username='oryx', principal='oryx/127.29.69.189@KRBTEST.COM'} at 127.0.0.1:58398)
I20260806 15:08:04.716287 3878 tablet_copy_service.cc:161] P e9ba2c64bce64496b9ee66d3b9f0382b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 3d7abb0686e3468eb5a1dd8edb83ea60 at {username='oryx', principal='oryx/127.29.69.189@KRBTEST.COM'} at 127.0.0.1:58398: session id = 3d7abb0686e3468eb5a1dd8edb83ea60-00000000000000000000000000000000
I20260806 15:08:04.716948 3878 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 15:08:04.717495 4334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 15:08:04.718530 4334 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: tablet copy: Starting download of 0 data blocks...
I20260806 15:08:04.718670 4334 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: tablet copy: Starting download of 1 WAL segments...
I20260806 15:08:04.719396 4334 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 15:08:04.720160 3878 tablet_copy_service.cc:342] P e9ba2c64bce64496b9ee66d3b9f0382b: Request end of tablet copy session 3d7abb0686e3468eb5a1dd8edb83ea60-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.69.189@KRBTEST.COM'} at 127.0.0.1:58398
I20260806 15:08:04.720206 3878 tablet_copy_service.cc:433] P e9ba2c64bce64496b9ee66d3b9f0382b: ending tablet copy session 3d7abb0686e3468eb5a1dd8edb83ea60-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 3d7abb0686e3468eb5a1dd8edb83ea60
I20260806 15:08:04.722692 4334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:04.723765 4443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.723824 4447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.723942 4444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.724050 4334 server_base.cc:1034] running on GCE node
I20260806 15:08:04.724223 4334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:04.724354 4334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:04.725485 4334 hybrid_clock.cc:648] HybridClock initialized: now 1786028884725483 us; error 35 us; skew 500 ppm
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:04.726775 4334 init.cc:377] Logged in from keytab as oryx/127.29.69.189@KRBTEST.COM (short username oryx)
I20260806 15:08:04.727100 4334 webserver.cc:460] Webserver started at http://127.29.69.189:46575/ using document root <none> and password file <none>
I20260806 15:08:04.727221 4334 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.727275 4334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.727849 4334 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:04.728343 4454 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.728468 4334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.728518 4334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c81b2c7c5d96d68bd2ada78a8de817bc"
server_key_iv: "e2cde4186b4c121633c45dfc45b36410"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.728569 4334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.743278 4334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.744958 4334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.748203 4334 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.189:43385
I20260806 15:08:04.748559 4506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.189:43385 every 8 connection(s)
I20260806 15:08:04.748600 4334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
I20260806 15:08:04.749310 4507 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:08:04.749699 4507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Bootstrap starting.
I20260806 15:08:04.751945 4507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:08:04.752174 4507 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: Bootstrap complete.
I20260806 15:08:04.752378 4507 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } }
I20260806 15:08:04.752493 4507 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 3d7abb0686e3468eb5a1dd8edb83ea60, State: Initialized, Role: LEARNER
I20260806 15:08:04.752552 4507 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } }
I20260806 15:08:04.752767 4507 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:04.752746 4510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } }
I20260806 15:08:04.752820 4510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: LEARNER
I20260806 15:08:04.754382 4521 catalog_manager.cc:1259] Loaded cluster ID: a1951d064150421e97e8733849ab84ea
I20260806 15:08:04.754438 4521 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: loading cluster ID for follower catalog manager: success
I20260806 15:08:04.755335 4521 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: acquiring CA information for follower catalog manager: success
I20260806 15:08:04.755615 4521 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:08:04.772467 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.765419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35674 (local address 127.29.69.189:43385)
0806 15:08:04.765527 (+ 108us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.765529 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.765537 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:04.765558 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.765559 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.765567 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.765636 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.766369 (+ 733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.767021 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.768052 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.768245 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.768293 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.769703 (+ 1410us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.769705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.769705 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.769711 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.771277 (+ 1566us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.771686 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.771688 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.771688 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.771745 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.771963 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.771963 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.771963 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.772067 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.772140 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.772294 (+ 154us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.772361 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":59,"threads_started":1}
WARNING: no policy specified for oryx/127.29.69.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.188.keytab.
Entry for principal oryx/127.29.69.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.188.keytab.
I20260806 15:08:04.795233 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:35147
--webserver_interface=127.29.69.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.188.keytab
--principal=oryx/127.29.69.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:04.876482 4527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:04.876662 4527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:04.876683 4527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:04.878038 4527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:04.878087 4527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:04.878103 4527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:04.878114 4527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:04.878145 4527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:04.880023 4527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.188.keytab
--principal=oryx/127.29.69.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:35147
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.69.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:04.880237 4527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:04.880457 4527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:04.885299 4534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.885445 4527 server_base.cc:1034] running on GCE node
W20260806 15:08:04.885279 4536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:04.885286 4533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:04.885776 4527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:04.886086 4527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:04.887238 4527 hybrid_clock.cc:648] HybridClock initialized: now 1786028884887226 us; error 25 us; skew 500 ppm
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:04.889582 4527 init.cc:377] Logged in from keytab as oryx/127.29.69.188@KRBTEST.COM (short username oryx)
I20260806 15:08:04.889999 4527 webserver.cc:460] Webserver started at http://127.29.69.188:36471/ using document root <none> and password file <none>
I20260806 15:08:04.890235 4527 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:04.890300 4527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:04.890475 4527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:04.891453 4527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/instance:
uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "d1bd13aacb47d63e4612d2233a50517f"
server_key_iv: "120eeb1422d57d762e6d68ef2e4fe03a"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.891799 4527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal/instance:
uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "d1bd13aacb47d63e4612d2233a50517f"
server_key_iv: "120eeb1422d57d762e6d68ef2e4fe03a"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.893209 4527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:04.893926 4543 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:04.894121 4527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:04.894219 4527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "d1bd13aacb47d63e4612d2233a50517f"
server_key_iv: "120eeb1422d57d762e6d68ef2e4fe03a"
server_key_version: "encryptionkey@0"
I20260806 15:08:04.894304 4527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:04.924777 4527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:04.926623 4527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:04.926780 4527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:04.930795 4527 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.188:35147
I20260806 15:08:04.930832 4595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.188:35147 every 8 connection(s)
I20260806 15:08:04.931200 4527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
I20260806 15:08:04.932186 4596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:04.933840 4596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.188@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:04.940011 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4527
I20260806 15:08:04.942777 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.934699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58400 (local address 127.29.69.190:46287)
0806 15:08:04.934752 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.934754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.934817 (+ 63us) server_negotiation.cc:407] Connection header received
0806 15:08:04.935241 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.935242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.935251 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.935302 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.935874 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.936363 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.937294 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.937472 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.937521 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.939590 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.939592 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.939593 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.939599 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.941330 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.941794 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.941795 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.941795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.941852 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.942115 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.942116 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.942116 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.942216 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.942266 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.942587 (+ 321us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.942676 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:08:04.942930 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.934524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58400)
0806 15:08:04.934688 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.934733 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.935160 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.935374 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.935377 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.935618 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.935798 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.935802 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.936436 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.936437 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.937217 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.937219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.937550 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.937551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.937662 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.938075 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.938083 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.939504 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.941424 (+ 1920us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.941431 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.941433 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.941718 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.941915 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.941916 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.941917 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.942051 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.942277 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.942281 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.942442 (+ 161us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.942545 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.942703 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
I20260806 15:08:04.943449 4596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.69.188@KRBTEST.COM
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.188@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
I20260806 15:08:04.949295 4599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.940570 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38906 (local address 127.29.69.188:35147)
0806 15:08:04.940807 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.940811 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.940830 (+ 19us) server_negotiation.cc:407] Connection header received
0806 15:08:04.940853 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.940854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.940868 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.940955 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.941585 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.942614 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.943638 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.944077 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.944159 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.946491 (+ 2332us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.946500 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.946500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.946507 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.948145 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.948493 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.948496 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.948496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.948552 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.948761 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.948762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.948763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.948892 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.949049 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.949115 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.949188 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":109,"threads_started":1}
I20260806 15:08:04.950436 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.943675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35686)
0806 15:08:04.943724 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.943735 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.943772 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.943938 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.943939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.944042 (+ 103us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.944088 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.944089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.944930 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.944931 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.945438 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.945439 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.945882 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.945883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.945961 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.946385 (+ 424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.946390 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.947781 (+ 1391us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.949350 (+ 1569us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.949351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.949351 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.949555 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.949780 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.949781 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.949782 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.949846 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.950104 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.950104 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.950145 (+ 41us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.950234 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.950350 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 15:08:04.950460 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.943772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35686 (local address 127.29.69.189:43385)
0806 15:08:04.943816 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.943818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.943825 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:04.943850 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.943851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.943864 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.943923 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.944182 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.944805 (+ 623us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.945541 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.945803 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.945879 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.947882 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.947883 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.947883 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.947890 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.949255 (+ 1365us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.949634 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.949635 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.949635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.949701 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.949905 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.949906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.949907 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.950033 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.950112 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.950263 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.950368 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:08:04.950930 4596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028884, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.188@KRBTEST.COM for oryx/127.29.69.188@KRBTEST.COM
I20260806 15:08:04.956506 4598 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.951164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.0.0.1:38914)
0806 15:08:04.951244 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.951253 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.951294 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.951401 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.951401 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.951533 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.951555 (+ 22us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.951556 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.952152 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.952153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.952648 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.952650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.952996 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.952997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.953045 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.953378 (+ 333us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.953382 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.954641 (+ 1259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.955808 (+ 1167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.955808 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.955809 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.955969 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.956096 (+ 127us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.956096 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.956096 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.956136 (+ 40us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.956291 (+ 155us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.956292 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.956322 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.956367 (+ 45us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.956435 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70}
I20260806 15:08:04.956611 4599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.951212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38914 (local address 127.29.69.188:35147)
0806 15:08:04.951242 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.951243 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.951281 (+ 38us) server_negotiation.cc:407] Connection header received
0806 15:08:04.951346 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.951347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.951355 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.951400 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.951634 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.952077 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.952707 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.952911 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.952998 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.954699 (+ 1701us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.954700 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.954700 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.954706 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.955737 (+ 1031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.956023 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.956023 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.956024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.956061 (+ 37us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.956168 (+ 107us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.956168 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.956168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.956242 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.956284 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.956380 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.956474 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":14}
I20260806 15:08:04.958107 4596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Bootstrap starting.
I20260806 15:08:04.958982 4596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:04.959266 4596 log.cc:824] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:04.959933 4596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: No bootstrap required, opened a new log
I20260806 15:08:04.961398 4596 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } }
I20260806 15:08:04.961511 4596 raft_consensus.cc:374] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:04.961555 4596 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1c2766f3b9b4c7f81ed0f88c1c00971, State: Initialized, Role: FOLLOWER
I20260806 15:08:04.961678 4596 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } }
I20260806 15:08:04.961951 4596 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:04.961923 4601 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } } }
I20260806 15:08:04.962023 4601 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:08:04.963565 4612 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:08:04.963624 4612 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:08:04.965741 4527 master_runner.cc:428] Detected that this master d1c2766f3b9b4c7f81ed0f88c1c00971 is joining an existing cluster
I20260806 15:08:04.965780 4527 master_runner.cc:432] Initiating AddMaster RPC to add 127.29.69.188:35147
I20260806 15:08:04.973115 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.966851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.0.0.1:38922)
0806 15:08:04.967612 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.967622 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.967677 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.967806 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.967807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.967996 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.968051 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.968052 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.968728 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.968728 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.969249 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.969250 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.969698 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.969699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.969767 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.970153 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.970159 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.970597 (+ 438us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.972200 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.972201 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.972202 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.972364 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.972570 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.972571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.972571 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.972622 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.972867 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.972868 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.972900 (+ 32us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.972960 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.973047 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":746,"thread_start_us":101,"threads_started":1}
I20260806 15:08:04.973217 4599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.966951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38922 (local address 127.29.69.188:35147)
0806 15:08:04.967029 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.967030 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.967660 (+ 630us) server_negotiation.cc:407] Connection header received
0806 15:08:04.967732 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.967733 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.967739 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.967763 (+ 24us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.968122 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.968669 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.969326 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.969610 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.969670 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.970696 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.970697 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.970697 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.970704 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.972125 (+ 1421us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.972435 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.972436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.972437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.972497 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.972681 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.972682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.972682 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.972804 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.972871 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.972999 (+ 128us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.973113 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":64}
I20260806 15:08:04.990685 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.966913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58416 (local address 127.29.69.190:46287)
0806 15:08:04.967002 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.967004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.967144 (+ 140us) server_negotiation.cc:407] Connection header received
0806 15:08:04.967208 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.967210 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.967220 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.967269 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.967590 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.968363 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.969464 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.969755 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.969828 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.987263 (+ 17435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.987265 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.987266 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.987274 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.989315 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.989714 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.989715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.989715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.989772 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.990099 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.990101 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.990101 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.990245 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.990369 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.990519 (+ 150us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.990594 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260806 15:08:04.990698 4618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.966848 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58416)
0806 15:08:04.967078 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.967086 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.967157 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.967270 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.967271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.967437 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.967501 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.967502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.968449 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.968450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.969370 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.969372 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.969827 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.969828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.969895 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.986747 (+ 16852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.986751 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.987163 (+ 412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.989403 (+ 2240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.989404 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.989405 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.989630 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.989958 (+ 328us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.989959 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.989960 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.990025 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.990344 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.990345 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.990389 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.990482 (+ 93us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.990585 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":112,"threads_started":1}
I20260806 15:08:04.992470 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.967122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35692 (local address 127.29.69.189:43385)
0806 15:08:04.967161 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.967163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.970470 (+ 3307us) server_negotiation.cc:407] Connection header received
0806 15:08:04.970587 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.970588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.970598 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.970669 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.986699 (+ 16030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.987192 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.988246 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.988453 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.988546 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.989497 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.989498 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.989499 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.989506 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.991256 (+ 1750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.991655 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.991656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.991656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.991721 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.991926 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.991927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.991928 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.992058 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.992126 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:04.992304 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 15:08:04.992382 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:08:04.992492 4619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.967199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35692)
0806 15:08:04.970410 (+ 3211us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.970420 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.970507 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.970700 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.970701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.986537 (+ 15836us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.986605 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.986608 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.987314 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.987315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.988163 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.988166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.988546 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.988547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.988615 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.989001 (+ 386us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.989006 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.989376 (+ 370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.991356 (+ 1980us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.991357 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.991358 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.991588 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.991786 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.991787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.991787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.991851 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.992154 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.992155 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:04.992199 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 15:08:04.992277 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 15:08:04.992376 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3187,"thread_start_us":64,"threads_started":1}
Aug 06 15:08:04 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028883, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.190@KRBTEST.COM for oryx/127.29.69.188@KRBTEST.COM
I20260806 15:08:05.000293 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.993520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.0.0.1:38934)
0806 15:08:04.993584 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:04.993596 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:04.993650 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:04.993785 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:04.993786 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:04.993944 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:04.993988 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.993990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.994615 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.994616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.995427 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:04.995429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.995810 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.995811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:04.995884 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.996230 (+ 346us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:04.996234 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:04.997742 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:04.999292 (+ 1550us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.999293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.999294 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.999515 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.999696 (+ 181us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:04.999697 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:04.999697 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:04.999762 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:04.999972 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:04.999973 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.000020 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.000088 (+ 68us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.000189 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 15:08:05.000573 4599 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:04.993551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38934 (local address 127.29.69.188:35147)
0806 15:08:04.993587 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:04.993589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:04.993640 (+ 51us) server_negotiation.cc:407] Connection header received
0806 15:08:04.993713 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:04.993714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:04.993722 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:04.993763 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:04.994054 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.994542 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.995512 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:04.995732 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:04.995786 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:04.997851 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:04.997853 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:04.997853 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:04.997860 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:04.999214 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.999587 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.999588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.999588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.999633 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:04.999824 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:04.999825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:04.999825 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:04.999910 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:04.999957 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.000407 (+ 450us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.000477 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:08:05.000582 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3923
I20260806 15:08:05.003820 3858 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.29.69.188:35147: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
member_type: NON_VOTER
last_known_addr {
host: "127.29.69.188"
port: 35147
}
attrs {
promote: true
}
}
dest_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b"
cas_config_opid_index: 5
I20260806 15:08:05.004072 3858 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } }
I20260806 15:08:05.004961 4621 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.005030 4570 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:05.006072 4621 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.29.69.188:35147
I20260806 15:08:05.006145 4621 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.006207 4621 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:05.006875 4570 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Refusing update from remote peer e9ba2c64bce64496b9ee66d3b9f0382b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 15:08:05.009708 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:38687
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:46287
--webserver_port=39529
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:08:05.011869 4527 master.cc:537] Master@127.29.69.188:35147 shutting down...
I20260806 15:08:05.011855 4431 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:05.012748 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.004720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35702)
0806 15:08:05.004797 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.004807 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.004841 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.009165 (+ 4324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.009166 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.009168 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.009215 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.009217 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.010204 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.010206 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.011447 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.011450 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.012435 (+ 985us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.012436 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.012546 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.012572 (+ 26us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.012629 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.012683 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 15:08:05.013191 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.004916 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35702 (local address 127.29.69.189:43385)
0806 15:08:05.008975 (+ 4059us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.008977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.008999 (+ 22us) server_negotiation.cc:407] Connection header received
0806 15:08:05.009027 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.009028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.009053 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.009122 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.009314 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.010092 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.011567 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.012333 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.012946 (+ 613us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.013065 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.013087 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.013125 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4034}
I20260806 15:08:05.013412 4481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 LEARNER]: Refusing update from remote peer e9ba2c64bce64496b9ee66d3b9f0382b: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260806 15:08:05.013818 4431 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260806 15:08:05.013943 3842 consensus_peers.cc:487] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b -> Peer d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188:35147): Couldn't send request to peer d1c2766f3b9b4c7f81ed0f88c1c00971. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260806 15:08:05.015007 4481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.015957 4527 raft_consensus.cc:2229] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:05.016050 4527 raft_consensus.cc:2258] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:05.016098 4527 tablet_replica.cc:330] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: stopping tablet replica
I20260806 15:08:05.016922 4624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.016942 4510 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ba2c64bce64496b9ee66d3b9f0382b. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: NON_VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: true } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.017208 4431 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: attempting to promote NON_VOTER 3d7abb0686e3468eb5a1dd8edb83ea60 to VOTER
I20260806 15:08:05.017223 4510 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: LEARNER
I20260806 15:08:05.017397 4431 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } }
W20260806 15:08:05.018131 3842 connection.cc:535] client connection to 127.29.69.188:35147 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:08:05.018169 4481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 LEARNER]: Refusing update from remote peer e9ba2c64bce64496b9ee66d3b9f0382b: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260806 15:08:05.018446 4621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260806 15:08:05.018851 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.018731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.0.0.1:38940)
0806 15:08:05.018779 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.018818 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35147: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 15:08:05.019030 3842 consensus_peers.cc:487] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b -> Peer d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188:35147): Couldn't send request to peer d1c2766f3b9b4c7f81ed0f88c1c00971. Status: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35147: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:08:05.017102 4624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: LEARNER
I20260806 15:08:05.019309 4621 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.019582 4481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.020381 4621 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.020480 4431 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.020582 4431 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:05.020489 4621 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:05.020879 4624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.020987 4624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:08:05.030011 4527 master.cc:552] Master@127.29.69.188:35147 shutdown complete.
I20260806 15:08:05.030059 4527 master_runner.cc:305] Clearing existing system tablet
I20260806 15:08:05.030187 4527 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:05.030232 4527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:05.030985 4527 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.031513 4626 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.031623 4527 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:05.031667 4527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.031688 4527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "d1bd13aacb47d63e4612d2233a50517f"
server_key_iv: "120eeb1422d57d762e6d68ef2e4fe03a"
server_key_version: "encryptionkey@0"
I20260806 15:08:05.032549 4527 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:05.033841 4527 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260806 15:08:05.033910 4527 log.cc:1196] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260806 15:08:05.034109 4527 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Deleting consensus metadata
I20260806 15:08:05.034230 4527 master_runner.cc:315] Copying system tablet from 127.29.69.190:46287
I20260806 15:08:05.034932 4527 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: tablet copy: Beginning tablet copy session from remote peer at address 127.29.69.190:46287
I20260806 15:08:05.045442 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.038603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58428 (local address 127.29.69.190:46287)
0806 15:08:05.038659 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.038661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.038803 (+ 142us) server_negotiation.cc:407] Connection header received
0806 15:08:05.038837 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.038838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.038849 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.038919 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.039261 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.040017 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.041054 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.041344 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.041427 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.042533 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.042534 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.042535 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.042541 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.044199 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.044604 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.044606 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.044606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.044669 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.044880 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.044881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.044881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.045017 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.045089 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.045263 (+ 174us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.045356 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:08:05.045446 4632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.038544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58428)
0806 15:08:05.038711 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.038722 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.038790 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.038925 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.038926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.039116 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.039173 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.039175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.040107 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.040108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.040955 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.040959 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.041434 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.041435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.041511 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.042029 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.042034 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.042438 (+ 404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.044289 (+ 1851us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.044290 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.044291 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.044524 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.044744 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.044745 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.044745 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.044811 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.045089 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.045090 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.045159 (+ 69us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.045223 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.045335 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":64,"threads_started":1}
I20260806 15:08:05.046041 3878 tablet_copy_service.cc:140] P e9ba2c64bce64496b9ee66d3b9f0382b: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer d1c2766f3b9b4c7f81ed0f88c1c00971 ({username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:58428)
I20260806 15:08:05.046101 3878 tablet_copy_service.cc:161] P e9ba2c64bce64496b9ee66d3b9f0382b: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer d1c2766f3b9b4c7f81ed0f88c1c00971 at {username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:58428: session id = d1c2766f3b9b4c7f81ed0f88c1c00971-00000000000000000000000000000000
I20260806 15:08:05.046744 3878 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Tablet Copy: opened 0 blocks and 1 log segments
I20260806 15:08:05.047377 4527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260806 15:08:05.048637 4527 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: tablet copy: Starting download of 0 data blocks...
I20260806 15:08:05.048771 4527 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: tablet copy: Starting download of 1 WAL segments...
I20260806 15:08:05.049625 4527 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260806 15:08:05.050482 3878 tablet_copy_service.cc:342] P e9ba2c64bce64496b9ee66d3b9f0382b: Request end of tablet copy session d1c2766f3b9b4c7f81ed0f88c1c00971-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:58428
I20260806 15:08:05.050549 3878 tablet_copy_service.cc:433] P e9ba2c64bce64496b9ee66d3b9f0382b: ending tablet copy session d1c2766f3b9b4c7f81ed0f88c1c00971-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer d1c2766f3b9b4c7f81ed0f88c1c00971
I20260806 15:08:05.052899 4527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:05.054003 4634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.054116 4633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.054975 4636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:05.059135 4527 server_base.cc:1034] running on GCE node
I20260806 15:08:05.059234 4527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:05.059358 4527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:05.060493 4527 hybrid_clock.cc:648] HybridClock initialized: now 1786028885060482 us; error 27 us; skew 500 ppm
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:05.062016 4527 init.cc:377] Logged in from keytab as oryx/127.29.69.188@KRBTEST.COM (short username oryx)
I20260806 15:08:05.062266 4527 webserver.cc:460] Webserver started at http://127.29.69.188:46209/ using document root <none> and password file <none>
I20260806 15:08:05.062433 4527 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:05.062470 4527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:05.063205 4527 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:05.063798 4643 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.063974 4527 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:05.064028 4527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "d1bd13aacb47d63e4612d2233a50517f"
server_key_iv: "120eeb1422d57d762e6d68ef2e4fe03a"
server_key_version: "encryptionkey@0"
I20260806 15:08:05.064082 4527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:05.072228 4527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:05.074033 4527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:05.077070 4527 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.188:35147
I20260806 15:08:05.077435 4527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
I20260806 15:08:05.078455 4699 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.188:35147 every 8 connection(s)
I20260806 15:08:05.079120 4700 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:08:05.079598 4700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Bootstrap starting.
I20260806 15:08:05.082520 4700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:08:05.082726 4700 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Bootstrap complete.
I20260806 15:08:05.082907 4700 raft_consensus.cc:348] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } }
I20260806 15:08:05.083019 4700 raft_consensus.cc:729] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: d1c2766f3b9b4c7f81ed0f88c1c00971, State: Initialized, Role: LEARNER
I20260806 15:08:05.083061 4700 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } }
I20260806 15:08:05.083309 4700 sys_catalog.cc:564] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:05.083300 4703 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.083607 4703 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: This master's current role is: LEARNER
I20260806 15:08:05.084724 4714 catalog_manager.cc:1259] Loaded cluster ID: a1951d064150421e97e8733849ab84ea
I20260806 15:08:05.084812 4714 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: loading cluster ID for follower catalog manager: success
I20260806 15:08:05.085961 4714 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: acquiring CA information for follower catalog manager: success
I20260806 15:08:05.086344 4714 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260806 15:08:05.112011 4622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:05.112198 4622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:05.112221 4622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:05.113399 4622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:05.113440 4622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:05.113466 4622 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:05.115250 4622 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:38687
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=39529
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:05.115480 4622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:05.115707 4622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:05.120923 4722 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.120895 4719 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.120901 4720 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:05.121356 4622 server_base.cc:1034] running on GCE node
I20260806 15:08:05.121508 4622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:05.121695 4622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:05.122835 4622 hybrid_clock.cc:648] HybridClock initialized: now 1786028885122817 us; error 37 us; skew 500 ppm
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:05.125260 4622 init.cc:377] Logged in from keytab as oryx/127.29.69.129@KRBTEST.COM (short username oryx)
I20260806 15:08:05.125698 4622 webserver.cc:460] Webserver started at http://127.29.69.129:39529/ using document root <none> and password file <none>
I20260806 15:08:05.125942 4622 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:05.126016 4622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:05.127403 4622 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:05.127996 4729 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.128247 4622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:05.128343 4622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "a4dbb895b58a4130807ca10cd207efc8"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "c1206e2f8232972800584b9d4657d937"
server_key_iv: "0f17a949eaee52af89777da3d803b9ca"
server_key_version: "encryptionkey@0"
I20260806 15:08:05.128677 4622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:05.144433 4622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:05.146230 4622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:05.146431 4622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:05.146723 4622 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:05.147027 4622 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:05.147060 4622 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.147089 4622 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:05.147136 4622 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.156960 4622 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:38687
I20260806 15:08:05.157011 4846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:38687 every 8 connection(s)
I20260806 15:08:05.157400 4622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:05.158125 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4622
I20260806 15:08:05.158325 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4060
I20260806 15:08:05.167708 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:38231
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:46287
--webserver_port=46073
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.188@KRBTEST.COM
I20260806 15:08:05.175946 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.159592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:40911 (local address 127.29.69.190:46287)
0806 15:08:05.159670 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.159672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.159684 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:08:05.160480 (+ 796us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.160482 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.160496 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.160533 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.162541 (+ 2008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.163395 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.165112 (+ 1717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.165480 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.165526 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.168989 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.168991 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.168991 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.169000 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.174222 (+ 5222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.174913 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.174914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.174915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.174981 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.175232 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.175233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.175234 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.175383 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.175441 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.175768 (+ 327us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.175854 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 15:08:05.176143 4852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.158622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:40911)
0806 15:08:05.159221 (+ 599us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.159267 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.160337 (+ 1070us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.160756 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.160761 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.161828 (+ 1067us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.162426 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.162433 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.163626 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.163627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.164989 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.164992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.165622 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.165623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.165776 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.166664 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.166675 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.168872 (+ 2197us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.174348 (+ 5476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.174349 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.174350 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.174788 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.175061 (+ 273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.175062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.175062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.175120 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.175479 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.175480 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.175602 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.175725 (+ 123us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.175895 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":93,"thread_start_us":78,"threads_started":1}
I20260806 15:08:05.176283 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.160524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:46775 (local address 127.29.69.189:43385)
0806 15:08:05.160586 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.160588 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.160598 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:08:05.161348 (+ 750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.161350 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.161364 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.161397 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.162647 (+ 1250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.163571 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.165740 (+ 2169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.166615 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.166674 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.171505 (+ 4831us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.171506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.171507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.171515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.173656 (+ 2141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.174560 (+ 904us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.174561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.174562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.174624 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.174901 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.174903 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.174903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.175306 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.175364 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.176004 (+ 640us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.176135 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:08:05.177028 4848 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46287
I20260806 15:08:05.177160 4848 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.177356 4848 heartbeater.cc:511] Master 127.29.69.190:46287 requested a full tablet report, sending...
I20260806 15:08:05.177491 4851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.158889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.29.69.129:46775)
0806 15:08:05.159921 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.159932 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.161222 (+ 1290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.161470 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.161471 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.161863 (+ 392us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.162437 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.162491 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.163765 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.163766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.165627 (+ 1861us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.165630 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.167008 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.167010 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.167140 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.168968 (+ 1828us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.168974 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.171387 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.173781 (+ 2394us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.173790 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.173792 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.174471 (+ 679us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.174692 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.174693 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.174693 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.174832 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.175412 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.175420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.175852 (+ 432us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.177135 (+ 1283us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.177289 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1003,"mutex_wait_us":1,"thread_start_us":217,"threads_started":1}
I20260806 15:08:05.177948 3858 ts_manager.cc:194] Re-registered known tserver with Master: a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129:38687)
I20260806 15:08:05.178638 3858 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:40911
I20260806 15:08:05.178815 4853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.161347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.29.69.129:34659)
0806 15:08:05.166410 (+ 5063us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.166421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.166491 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.167982 (+ 1491us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.167983 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.168383 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.168600 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.168616 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.171030 (+ 2414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.171031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.171867 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.171869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.172402 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.172403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.172473 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.172887 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.172892 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.174557 (+ 1665us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.177590 (+ 3033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.177591 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.177591 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.177822 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.178033 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.178034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.178034 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.178103 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.178397 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.178398 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.178440 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.178527 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.178635 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5030,"thread_start_us":103,"threads_started":1}
I20260806 15:08:05.178841 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.161581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:34659 (local address 127.29.69.188:35147)
0806 15:08:05.161723 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.161725 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.166736 (+ 5011us) server_negotiation.cc:407] Connection header received
0806 15:08:05.166779 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.166781 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.166796 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.166902 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.169464 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.170913 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.171964 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.172291 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.172350 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.174651 (+ 2301us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.174654 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.174654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.174662 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.176900 (+ 2238us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.177906 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.177908 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.177908 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.177967 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.178180 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.178181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.178181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.178339 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.178406 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.178573 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.178657 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":49,"threads_started":1}
I20260806 15:08:05.179499 4849 heartbeater.cc:347] Connected to a master server at 127.29.69.189:43385
I20260806 15:08:05.179579 4849 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.179653 4849 heartbeater.cc:511] Master 127.29.69.189:43385 requested a full tablet report, sending...
I20260806 15:08:05.179801 4847 heartbeater.cc:347] Connected to a master server at 127.29.69.188:35147
I20260806 15:08:05.179862 4847 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.179929 4847 heartbeater.cc:511] Master 127.29.69.188:35147 requested a full tablet report, sending...
I20260806 15:08:05.180105 4471 ts_manager.cc:194] Registered new tserver with Master: a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129:38687)
I20260806 15:08:05.180328 4661 ts_manager.cc:194] Registered new tserver with Master: a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129:38687)
W20260806 15:08:05.288075 4855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:05.288383 4855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:05.288424 4855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:05.289601 4855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:05.289667 4855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:05.289713 4855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:05.291456 4855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:38231
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=46073
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:05.291729 4855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:05.291966 4855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:05.297712 4861 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:05.299629 4855 server_base.cc:1034] running on GCE node
W20260806 15:08:05.299685 4863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.299731 4860 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:05.299958 4855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:05.300218 4855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:05.301371 4855 hybrid_clock.cc:648] HybridClock initialized: now 1786028885301357 us; error 28 us; skew 500 ppm
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:05.303857 4855 init.cc:377] Logged in from keytab as oryx/127.29.69.130@KRBTEST.COM (short username oryx)
I20260806 15:08:05.304235 4855 webserver.cc:460] Webserver started at http://127.29.69.130:46073/ using document root <none> and password file <none>
I20260806 15:08:05.304412 4855 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:05.304461 4855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:05.305804 4855 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:05.306416 4870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.306589 4855 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:05.306689 4855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "a1d73c25e8f24b269c38185695dbfd6e"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "e9b4b1db1182e21fc36323064489571d"
server_key_iv: "1b1731a608be3c91a89af9d177e8588a"
server_key_version: "encryptionkey@0"
I20260806 15:08:05.307039 4855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:05.314642 4855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:05.316601 4855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:05.316809 4855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:05.317034 4855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:05.317374 4855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:05.317420 4855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.317459 4855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:05.317487 4855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.326270 4855 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:38231
I20260806 15:08:05.326501 4987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:38231 every 8 connection(s)
I20260806 15:08:05.326722 4855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:05.334201 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4855
I20260806 15:08:05.334380 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4196
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.188@KRBTEST.COM
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
I20260806 15:08:05.340178 4992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.327436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.29.69.130:38593)
0806 15:08:05.327721 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.327785 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.329208 (+ 1423us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.329579 (+ 371us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.329580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.330074 (+ 494us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.330423 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.330430 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.331416 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.331417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.332358 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.332361 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.332910 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.333104 (+ 193us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.333885 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.333890 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.336243 (+ 2353us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.339066 (+ 2823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.339066 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.339067 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.339259 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.339465 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.339466 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.339467 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.339534 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.339825 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.339826 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.339859 (+ 33us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.339943 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.340021 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":92,"thread_start_us":143,"threads_started":1}
I20260806 15:08:05.340247 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.327463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:38593 (local address 127.29.69.188:35147)
0806 15:08:05.327886 (+ 423us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.327889 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.327901 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:08:05.329320 (+ 1419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.329322 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.329337 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.329397 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.330545 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.331319 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332454 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.332825 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332891 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.336354 (+ 3463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.336355 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.336356 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.336363 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.338988 (+ 2625us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.339341 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.339342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.339343 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.339393 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.339610 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.339611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.339611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.339739 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.339779 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.340001 (+ 222us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.340102 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396}
I20260806 15:08:05.340613 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.327831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:35447 (local address 127.29.69.190:46287)
0806 15:08:05.327937 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.327939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.328178 (+ 239us) server_negotiation.cc:407] Connection header received
0806 15:08:05.329481 (+ 1303us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.329483 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.329494 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.329579 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.330540 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.331317 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332635 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.332919 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332990 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.336351 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.336353 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.336353 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.336363 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.338167 (+ 1804us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.338886 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.338887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.338888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.338949 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.339247 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.339248 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.339249 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.339388 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.339453 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.340473 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.340553 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260806 15:08:05.340209 4993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.327437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:35447)
0806 15:08:05.328080 (+ 643us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.328090 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.329225 (+ 1135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.329645 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.329646 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.330075 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.330423 (+ 348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.330430 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.331398 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.331399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.332516 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.332519 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.332986 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.333109 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.333841 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.333846 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.336243 (+ 2397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.338485 (+ 2242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.338493 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.338495 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.338790 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.339033 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.339034 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.339035 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.339166 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.339478 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.339485 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.339649 (+ 164us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.339743 (+ 94us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.339923 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":610,"mutex_wait_us":96,"thread_start_us":214,"threads_started":1}
I20260806 15:08:05.341096 4989 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46287
I20260806 15:08:05.341203 4989 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.341395 4989 heartbeater.cc:511] Master 127.29.69.190:46287 requested a full tablet report, sending...
I20260806 15:08:05.341754 3858 ts_manager.cc:194] Re-registered known tserver with Master: a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231)
I20260806 15:08:05.342133 3858 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:35447
I20260806 15:08:05.342878 4988 heartbeater.cc:347] Connected to a master server at 127.29.69.188:35147
I20260806 15:08:05.342929 4988 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.343003 4988 heartbeater.cc:511] Master 127.29.69.188:35147 requested a full tablet report, sending...
I20260806 15:08:05.343317 4661 ts_manager.cc:194] Registered new tserver with Master: a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231)
I20260806 15:08:05.343828 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:41331
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:46287
--webserver_port=37447
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45221
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:08:05.344590 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.328483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:49557 (local address 127.29.69.189:43385)
0806 15:08:05.328552 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.328554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.328656 (+ 102us) server_negotiation.cc:407] Connection header received
0806 15:08:05.329398 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.329400 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.329419 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.329462 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.330529 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.331104 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.332712 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.333006 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.333071 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.337283 (+ 4212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.337285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.337286 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.337294 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.343420 (+ 6126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.343801 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.343803 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.343803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.343869 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.344101 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.344102 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.344103 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.344218 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.344274 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.344462 (+ 188us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.344528 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:08:05.344739 4994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.328391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.29.69.130:49557)
0806 15:08:05.328587 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.328598 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.329269 (+ 671us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.329568 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.329573 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.330063 (+ 490us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.330423 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.330429 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.331273 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.331274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.332636 (+ 1362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.332638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.333133 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.333133 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.333193 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.333770 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.333796 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.337167 (+ 3371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.343510 (+ 6343us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.343511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.343512 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.343727 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.343961 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.343962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.343962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.344036 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.344287 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.344288 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.344335 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.344434 (+ 99us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.344560 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":106,"thread_start_us":67,"threads_started":1}
I20260806 15:08:05.345324 4990 heartbeater.cc:347] Connected to a master server at 127.29.69.189:43385
I20260806 15:08:05.345402 4990 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.345453 4990 heartbeater.cc:511] Master 127.29.69.189:43385 requested a full tablet report, sending...
I20260806 15:08:05.345780 4471 ts_manager.cc:194] Registered new tserver with Master: a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231)
W20260806 15:08:05.426836 4995 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:05.427040 4995 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:05.427070 4995 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:05.428143 4995 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:05.428175 4995 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:05.428248 4995 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:05.429700 4995 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45221
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:41331
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=37447
--tserver_master_addrs=127.29.69.190:46287,127.29.69.189:43385,127.29.69.188:35147
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:05.429877 4995 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:05.430061 4995 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:05.435144 5000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.435134 5001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:05.435133 5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:05.435285 4995 server_base.cc:1034] running on GCE node
I20260806 15:08:05.435564 4995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:05.435801 4995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:05.436959 4995 hybrid_clock.cc:648] HybridClock initialized: now 1786028885436953 us; error 34 us; skew 500 ppm
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:05.439476 4995 init.cc:377] Logged in from keytab as oryx/127.29.69.131@KRBTEST.COM (short username oryx)
I20260806 15:08:05.439901 4995 webserver.cc:460] Webserver started at http://127.29.69.131:37447/ using document root <none> and password file <none>
I20260806 15:08:05.440126 4995 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:05.440209 4995 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:05.441526 4995 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:05.442083 5010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.442240 4995 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:05.442370 4995 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "de0b9952227e4b0f82502b9b07dc61aa"
format_stamp: "Formatted at 2026-08-06 15:08:04 on dist-test-slave-tm1g"
server_key: "30e36a96a8efd9c596385faab5e5bd19"
server_key_iv: "f8b8af5d8ff7cd2d0a839dfe159d67f2"
server_key_version: "encryptionkey@0"
I20260806 15:08:05.442703 4995 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:05.455392 4995 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:05.457616 4995 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:05.457772 4995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:05.457988 4995 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:05.458295 4995 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:05.458382 4995 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.458438 4995 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:05.458464 4995 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:05.464473 4995 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:41331
I20260806 15:08:05.464578 5127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:41331 every 8 connection(s)
I20260806 15:08:05.464913 4995 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:05.468911 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 4995
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.189@KRBTEST.COM
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:05.478330 4523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.465660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:44743 (local address 127.29.69.189:43385)
0806 15:08:05.465772 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.465774 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.466036 (+ 262us) server_negotiation.cc:407] Connection header received
0806 15:08:05.466696 (+ 660us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.466698 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.466712 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.466768 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.467745 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.468248 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.469901 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.470192 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.470268 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.473589 (+ 3321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.473590 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.473591 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.473598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.475580 (+ 1982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.477199 (+ 1619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.477202 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.477202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.477267 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.477562 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.477563 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.477563 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.477733 (+ 170us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.477805 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.478118 (+ 313us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.478198 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260806 15:08:05.478552 5132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.465664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.29.69.131:44743)
0806 15:08:05.465972 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.465983 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.466591 (+ 608us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.467143 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.467144 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.467417 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.467641 (+ 224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.467646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.468359 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.468360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.469545 (+ 1185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.469549 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.470356 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.470358 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.470434 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.471020 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.471026 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.473484 (+ 2458us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.475988 (+ 2504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.475995 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.475997 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.476312 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.477350 (+ 1038us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.477351 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.477352 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.477495 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.477796 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.477804 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.477970 (+ 166us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.478088 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.478279 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":18,"thread_start_us":137,"threads_started":1}
Aug 06 15:08:05 dist-test-slave-tm1g krb5kdc[3813](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028885, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.188@KRBTEST.COM
I20260806 15:08:05.479139 3910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.466187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:43779 (local address 127.29.69.190:46287)
0806 15:08:05.466230 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.466232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.466240 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:05.466717 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.466719 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.466732 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.466766 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.467754 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.468529 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.469725 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.470023 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.470063 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.474613 (+ 4550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.474615 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.474615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.474623 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.477130 (+ 2507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.477882 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.477883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.477883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.477944 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.478537 (+ 593us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.478538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.478538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.478685 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.478742 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.478960 (+ 218us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.479040 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:08:05.479434 5130 heartbeater.cc:347] Connected to a master server at 127.29.69.189:43385
I20260806 15:08:05.479532 5134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.466018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:43779)
0806 15:08:05.466134 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.466143 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.466595 (+ 452us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.466863 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.466864 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.467425 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.467642 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.467648 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.468631 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.468632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.469636 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.469638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.470134 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.470134 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.470269 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.471253 (+ 984us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.471258 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.474488 (+ 3230us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.477598 (+ 3110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.477599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.477600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.477825 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.478023 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.478024 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.478025 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.478448 (+ 423us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.478800 (+ 352us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.478801 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.478846 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.479260 (+ 414us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.479367 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":101,"mutex_wait_us":6,"thread_start_us":69,"threads_started":1}
I20260806 15:08:05.479554 5130 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.479751 5130 heartbeater.cc:511] Master 127.29.69.189:43385 requested a full tablet report, sending...
I20260806 15:08:05.479794 5139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.469955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38954 (local address 127.29.69.188:35147)
0806 15:08:05.470197 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.470199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.470389 (+ 190us) server_negotiation.cc:407] Connection header received
0806 15:08:05.470411 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.470412 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.470426 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.470481 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.471360 (+ 879us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.471868 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.472962 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.473258 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.473302 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.475645 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.475646 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.475646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.475654 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.478503 (+ 2849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.478904 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.478905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.478906 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.478961 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.479168 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.479169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.479169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.479296 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.479371 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.479610 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.479693 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":48,"threads_started":1}
I20260806 15:08:05.480069 5129 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46287
I20260806 15:08:05.480142 5129 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.480216 5129 heartbeater.cc:511] Master 127.29.69.190:46287 requested a full tablet report, sending...
I20260806 15:08:05.480485 4471 ts_manager.cc:194] Registered new tserver with Master: de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:05.480854 3858 ts_manager.cc:194] Re-registered known tserver with Master: de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:05.481355 3858 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:43779
I20260806 15:08:05.483208 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.471271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35706 (local address 127.29.69.189:43385)
0806 15:08:05.472020 (+ 749us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.472021 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.472297 (+ 276us) server_negotiation.cc:407] Connection header received
0806 15:08:05.472395 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.472396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.472409 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.472450 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.473272 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.474031 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.475152 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.475457 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.475497 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.477258 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.477259 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.477260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.477267 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.481424 (+ 4157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.481838 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.481839 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.481840 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.481899 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482274 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.482276 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.482276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.482430 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.482531 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.482850 (+ 319us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.482942 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":733,"thread_start_us":54,"threads_started":1}
I20260806 15:08:05.483424 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.465706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:41245 (local address 127.29.69.188:35147)
0806 15:08:05.465752 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.465755 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.466023 (+ 268us) server_negotiation.cc:407] Connection header received
0806 15:08:05.466716 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.466718 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.466732 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.466766 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.467754 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.468528 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.469660 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.469954 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.469993 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.480434 (+ 10441us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.480435 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.480435 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.480442 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.482103 (+ 1661us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482508 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.482509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.482509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.482582 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482828 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.482829 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.482829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.482965 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.483014 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.483216 (+ 202us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.483299 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:08:05.483847 5142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.470811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.29.69.190:46287)
0806 15:08:05.471976 (+ 1165us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.471978 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.472148 (+ 170us) server_negotiation.cc:407] Connection header received
0806 15:08:05.472218 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.472219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.472232 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.472300 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.473283 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.474026 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.475149 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.475458 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.475497 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.477259 (+ 1762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.477260 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.477260 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.477268 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.482114 (+ 4846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482535 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.482536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.482537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.482640 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482874 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.482875 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.482875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.482998 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.483202 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.483599 (+ 397us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.483736 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1141,"thread_start_us":92,"threads_started":1}
I20260806 15:08:05.483873 5133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.465664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.29.69.131:41245)
0806 15:08:05.465883 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.465927 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.466585 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.466855 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.466861 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.467421 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:05.467642 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.467648 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.468631 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.468632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.469556 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.469559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.470101 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.470102 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.470268 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.471001 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:05.471021 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:05.480332 (+ 9311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:05.482175 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482175 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.482176 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.482426 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.482673 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:05.482673 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:05.482674 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:05.482751 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:05.483048 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:05.483049 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:05.483106 (+ 57us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.483538 (+ 432us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.483665 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":6,"spinlock_wait_cycles":7552,"thread_start_us":144,"threads_started":1}
I20260806 15:08:05.484254 5128 heartbeater.cc:347] Connected to a master server at 127.29.69.188:35147
I20260806 15:08:05.484308 5128 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:05.484376 5128 heartbeater.cc:511] Master 127.29.69.188:35147 requested a full tablet report, sending...
I20260806 15:08:05.484647 4661 ts_manager.cc:194] Registered new tserver with Master: de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:05.488274 3858 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:08:05.490077 3858 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:05.498588 5150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.494323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:38687 (local address 127.0.0.1:56002)
0806 15:08:05.494995 (+ 672us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.495006 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.495172 (+ 166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.495358 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.495359 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.495361 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.495410 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.495412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.496331 (+ 919us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.496332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.497578 (+ 1246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.497580 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.498279 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.498280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.498395 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.498399 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.498442 (+ 43us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.498492 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":655,"mutex_wait_us":36,"thread_start_us":249,"threads_started":1}
I20260806 15:08:05.498680 4430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.494204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:38231 (local address 127.0.0.1:56154)
0806 15:08:05.494237 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.494249 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.494288 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.494859 (+ 571us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.494860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.494862 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.494910 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.494911 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.496368 (+ 1457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.496369 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.497568 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.497571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.498493 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.498494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.498551 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.498554 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.498581 (+ 27us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.498618 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18,"mutex_wait_us":50}
I20260806 15:08:05.498600 5149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.494283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:41331 (local address 127.0.0.1:59142)
0806 15:08:05.494455 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.494466 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.494521 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.495149 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.495150 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.495153 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.495191 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.495192 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.496407 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.496409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.497359 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.497362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.498286 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.498287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.498383 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.498389 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.498426 (+ 37us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.498486 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":28,"thread_start_us":131,"threads_started":1}
I20260806 15:08:05.498979 5153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.494708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56002 (local address 127.29.69.129:38687)
0806 15:08:05.494939 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.494943 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.495127 (+ 184us) server_negotiation.cc:407] Connection header received
0806 15:08:05.495261 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.495264 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.495282 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.495360 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.495463 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.496218 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.497687 (+ 1469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.498186 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.498279 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.498823 (+ 544us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.498852 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.498902 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":97,"threads_started":1}
I20260806 15:08:05.499182 5152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.494551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59142 (local address 127.29.69.131:41331)
0806 15:08:05.494787 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.494792 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.494803 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:08:05.495012 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.495015 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.495030 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.495134 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.495277 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.496303 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.497451 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.498180 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.498641 (+ 461us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.498733 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.498762 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.498808 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":95,"threads_started":1}
I20260806 15:08:05.499470 5151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.494406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56154 (local address 127.29.69.130:38231)
0806 15:08:05.494673 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.494678 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.494689 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:08:05.494731 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.494733 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.494749 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.494863 (+ 114us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.494990 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.496252 (+ 1262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.497666 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.498403 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.499153 (+ 750us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.499313 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.499340 (+ 27us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.499383 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":141,"threads_started":1}
I20260806 15:08:05.499773 5059 tablet_service.cc:1467] Processing CreateTablet for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3 (DEFAULT_TABLE table=test-table [id=f4f519e8158342aea2d066ba612fd487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:05.499845 4778 tablet_service.cc:1467] Processing CreateTablet for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3 (DEFAULT_TABLE table=test-table [id=f4f519e8158342aea2d066ba612fd487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:05.500208 5059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:05.500218 4778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:05.504491 5154 tablet_bootstrap.cc:492] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Bootstrap starting.
I20260806 15:08:05.504869 5155 tablet_bootstrap.cc:492] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Bootstrap starting.
I20260806 15:08:05.505363 5154 tablet_bootstrap.cc:654] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:05.505389 4920 tablet_service.cc:1467] Processing CreateTablet for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3 (DEFAULT_TABLE table=test-table [id=f4f519e8158342aea2d066ba612fd487]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:05.505776 4920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:05.505914 5155 tablet_bootstrap.cc:654] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:05.506011 5154 log.cc:824] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:05.506690 5155 log.cc:824] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:05.507181 5154 tablet_bootstrap.cc:492] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: No bootstrap required, opened a new log
I20260806 15:08:05.507268 5154 ts_tablet_manager.cc:1397] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s
I20260806 15:08:05.507639 5155 tablet_bootstrap.cc:492] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: No bootstrap required, opened a new log
I20260806 15:08:05.507714 5155 ts_tablet_manager.cc:1397] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260806 15:08:05.511238 5158 tablet_bootstrap.cc:492] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Bootstrap starting.
I20260806 15:08:05.511732 5154 raft_consensus.cc:348] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.511977 5154 raft_consensus.cc:374] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:05.512053 5154 raft_consensus.cc:729] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de0b9952227e4b0f82502b9b07dc61aa, State: Initialized, Role: FOLLOWER
I20260806 15:08:05.512166 5158 tablet_bootstrap.cc:654] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:05.512200 5154 consensus_queue.cc:260] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.512513 5154 ts_tablet_manager.cc:1428] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s
I20260806 15:08:05.512486 5155 raft_consensus.cc:348] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.512662 5129 heartbeater.cc:503] Master 127.29.69.190:46287 was elected leader, sending a full tablet report...
I20260806 15:08:05.512666 5155 raft_consensus.cc:374] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:05.512702 5155 raft_consensus.cc:729] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4dbb895b58a4130807ca10cd207efc8, State: Initialized, Role: FOLLOWER
I20260806 15:08:05.512825 5155 consensus_queue.cc:260] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.513113 5158 log.cc:824] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:05.513700 5155 ts_tablet_manager.cc:1428] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Time spent starting tablet: real 0.006s user 0.000s sys 0.006s
I20260806 15:08:05.513815 4848 heartbeater.cc:503] Master 127.29.69.190:46287 was elected leader, sending a full tablet report...
I20260806 15:08:05.515373 5158 tablet_bootstrap.cc:492] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: No bootstrap required, opened a new log
I20260806 15:08:05.515455 5158 ts_tablet_manager.cc:1397] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 15:08:05.518163 5158 raft_consensus.cc:348] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.518288 5158 raft_consensus.cc:374] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:05.518388 5158 raft_consensus.cc:729] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d73c25e8f24b269c38185695dbfd6e, State: Initialized, Role: FOLLOWER
I20260806 15:08:05.518504 5158 consensus_queue.cc:260] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.518747 5158 ts_tablet_manager.cc:1428] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260806 15:08:05.518877 4989 heartbeater.cc:503] Master 127.29.69.190:46287 was elected leader, sending a full tablet report...
I20260806 15:08:05.541337 5161 raft_consensus.cc:482] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:05.541517 5161 raft_consensus.cc:504] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.541927 5161 leader_election.cc:288] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231), de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:05.546569 5151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.542216 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:45311 (local address 127.29.69.130:38231)
0806 15:08:05.542272 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.542274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.542285 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:08:05.542527 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.542528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.542541 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.542610 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.542980 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.543691 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.545487 (+ 1796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.546118 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.546199 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.546209 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.546453 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.546495 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 15:08:05.546578 5152 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.542203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:45595 (local address 127.29.69.131:41331)
0806 15:08:05.542272 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.542274 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.542523 (+ 249us) server_negotiation.cc:407] Connection header received
0806 15:08:05.542553 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.542555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.542564 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.542623 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.542909 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.543699 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.545487 (+ 1788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.546120 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.546199 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.546209 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.546466 (+ 257us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.546520 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 15:08:05.546597 4851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.542125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:38231 (local address 127.29.69.129:45311)
0806 15:08:05.542214 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.542226 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.542288 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.542640 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.542641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.542642 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.542902 (+ 260us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.542904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.543810 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.543811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.545380 (+ 1569us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.545384 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.546208 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.546209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.546359 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.546363 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.546430 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.546486 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":83}
I20260806 15:08:05.546640 4853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.542125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:41331 (local address 127.29.69.129:45595)
0806 15:08:05.542400 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.542407 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.542434 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.542640 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.542641 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.542642 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.542818 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.542821 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.543810 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.543811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.545383 (+ 1572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.545384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.546208 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.546209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.546390 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.546393 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.546447 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.546492 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":264,"mutex_wait_us":102}
I20260806 15:08:05.547156 4940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1b73d43a7c4fe2a48aebeb5aa386a3" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d73c25e8f24b269c38185695dbfd6e" is_pre_election: true
I20260806 15:08:05.547351 4940 raft_consensus.cc:2454] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 0.
I20260806 15:08:05.547349 5080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1b73d43a7c4fe2a48aebeb5aa386a3" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de0b9952227e4b0f82502b9b07dc61aa" is_pre_election: true
I20260806 15:08:05.547489 5080 raft_consensus.cc:2454] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 0.
I20260806 15:08:05.547673 4731 leader_election.cc:302] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1d73c25e8f24b269c38185695dbfd6e, a4dbb895b58a4130807ca10cd207efc8; no voters:
I20260806 15:08:05.547842 5161 raft_consensus.cc:2781] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:05.547940 5161 raft_consensus.cc:482] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:05.547979 5161 raft_consensus.cc:3037] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:05.568477 5161 raft_consensus.cc:504] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.568774 5161 leader_election.cc:288] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 election: Requested vote from peers a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231), de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:05.568885 4940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1b73d43a7c4fe2a48aebeb5aa386a3" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d73c25e8f24b269c38185695dbfd6e"
I20260806 15:08:05.568962 5080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c1b73d43a7c4fe2a48aebeb5aa386a3" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de0b9952227e4b0f82502b9b07dc61aa"
I20260806 15:08:05.569021 4940 raft_consensus.cc:3037] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:05.569058 5080 raft_consensus.cc:3037] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:05.570616 5080 raft_consensus.cc:2454] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 1.
I20260806 15:08:05.570693 4940 raft_consensus.cc:2454] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 1.
I20260806 15:08:05.570922 4733 leader_election.cc:302] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4dbb895b58a4130807ca10cd207efc8, de0b9952227e4b0f82502b9b07dc61aa; no voters:
I20260806 15:08:05.571061 5161 raft_consensus.cc:2781] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:05.571290 5161 raft_consensus.cc:686] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 1 LEADER]: Becoming Leader. State: Replica: a4dbb895b58a4130807ca10cd207efc8, State: Running, Role: LEADER
I20260806 15:08:05.571417 5161 consensus_queue.cc:237] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:05.572535 3858 catalog_manager.cc:5495] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "a4dbb895b58a4130807ca10cd207efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } health_report { overall_health: HEALTHY } } }
W20260806 15:08:05.578584 4991 tablet.cc:2369] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:08:05.590248 5153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.587159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56012 (local address 127.29.69.129:38687)
0806 15:08:05.587311 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.587313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.587320 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:05.587357 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.587358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.587377 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.587442 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:05.587657 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.588471 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.589208 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.589589 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.589673 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.589853 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:05.589987 (+ 134us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:05.590083 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.590100 (+ 17us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.590126 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121}
I20260806 15:08:05.592206 4940 raft_consensus.cc:1261] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Refusing update from remote peer a4dbb895b58a4130807ca10cd207efc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:05.592322 5080 raft_consensus.cc:1261] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Refusing update from remote peer a4dbb895b58a4130807ca10cd207efc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:05.592551 5161 consensus_queue.cc:1035] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:05.592767 5163 consensus_queue.cc:1035] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:05.597958 5149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.594633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.0.0.1:38964)
0806 15:08:05.594680 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:05.594691 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:05.594728 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:05.594939 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:05.594940 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:05.594942 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:05.595008 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.595010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.595874 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.595875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.596914 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:05.596917 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.597693 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.597694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:05.597755 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.597758 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:05.597806 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 15:08:05.597857 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260806 15:08:05.598389 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.594720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38964 (local address 127.29.69.188:35147)
0806 15:08:05.594760 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.594763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.594770 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:05.594797 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.594798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.594821 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.594884 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:05.595117 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.595787 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.597047 (+ 1260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.597618 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.597684 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.597763 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.598236 (+ 473us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.598276 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:08:05.598599 5167 mvcc.cc:205] Tried to move back new op lower bound from 7315574315382788096 to 7315574315301670912. Current Snapshot: MvccSnapshot[applied={T|T < 7315574315382788096}]
I20260806 15:08:05.598858 4673 raft_consensus.cc:1203] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.10] Dedup: 1.7->[1.8-1.10]
I20260806 15:08:05.600395 5174 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9ba2c64bce64496b9ee66d3b9f0382b. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.600494 5174 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: This master's current role is: LEARNER
I20260806 15:08:05.601666 3858 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:05.601756 3858 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:05.602324 5180 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: NON_VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: true } } }
I20260806 15:08:05.602422 5180 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:05.602943 5180 raft_consensus.cc:1050] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: attempting to promote NON_VOTER d1c2766f3b9b4c7f81ed0f88c1c00971 to VOTER
I20260806 15:08:05.603080 5180 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:05.603614 4673 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 LEARNER]: Refusing update from remote peer e9ba2c64bce64496b9ee66d3b9f0382b: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260806 15:08:05.603688 3858 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b: Sending DeleteTablet for 3 replicas of tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3
I20260806 15:08:05.603897 4621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Connected to new peer: Peer: permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260806 15:08:05.603966 4481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Refusing update from remote peer e9ba2c64bce64496b9ee66d3b9f0382b: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20260806 15:08:05.604094 5059 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:05 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:59142
I20260806 15:08:05.604440 5183 tablet_replica.cc:330] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: stopping tablet replica
I20260806 15:08:05.604560 5183 raft_consensus.cc:2229] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:05.604671 5183 raft_consensus.cc:2258] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:05.604753 4778 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:05 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56002
I20260806 15:08:05.604878 4621 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260806 15:08:05.605022 4920 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c1b73d43a7c4fe2a48aebeb5aa386a3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:05 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56154
I20260806 15:08:05.605021 4621 raft_consensus.cc:2932] T 00000000000000000000000000000000 P e9ba2c64bce64496b9ee66d3b9f0382b [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 7 to 12, d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:05.605182 5185 tablet_replica.cc:330] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: stopping tablet replica
I20260806 15:08:05.605192 5183 ts_tablet_manager.cc:1905] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:05.605270 5185 raft_consensus.cc:2229] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:05.605405 5185 raft_consensus.cc:2258] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:05.605831 5185 ts_tablet_manager.cc:1905] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:05.606343 4481 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 7 to 12, d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:05.607177 5186 tablet_replica.cc:330] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: stopping tablet replica
I20260806 15:08:05.607277 5186 raft_consensus.cc:2229] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:05.607369 5186 raft_consensus.cc:2258] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:05.607484 4673 raft_consensus.cc:2932] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 7 to 12, d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:05.607826 5186 ts_tablet_manager.cc:1905] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:05.617585 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.605306 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38974 (local address 127.29.69.188:35147)
0806 15:08:05.605361 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.605364 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.610485 (+ 5121us) server_negotiation.cc:407] Connection header received
0806 15:08:05.610553 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.610554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.610563 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.610612 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.611332 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.611802 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.612825 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.613016 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.613069 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.614605 (+ 1536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.614606 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.614606 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.614612 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.616421 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.616814 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.616814 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.616815 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.616868 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.617062 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.617063 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.617063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.617204 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.617283 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.617455 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.617519 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:08:05.671173 5183 ts_tablet_manager.cc:1918] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:05.671228 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 3826
I20260806 15:08:05.671404 5183 log.cc:1196] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/1c1b73d43a7c4fe2a48aebeb5aa386a3
I20260806 15:08:05.671851 5183 ts_tablet_manager.cc:1939] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P de0b9952227e4b0f82502b9b07dc61aa: Deleting consensus metadata
I20260806 15:08:05.673444 5174 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:05.673568 5174 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:08:05.674855 5187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:05.675040 5187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:08:05.681140 4646 connection.cc:535] server connection from 127.0.0.1:38964 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:08:05.681298 4457 connection.cc:535] server connection from 127.0.0.1:35702 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:08:05.686580 5013 connection.cc:441] server connection from 127.0.0.1:59142 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59142 (request call id 1) could send its response
I20260806 15:08:05.691867 4854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.683079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38984 (local address 127.29.69.188:35147)
0806 15:08:05.683121 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.683125 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.683527 (+ 402us) server_negotiation.cc:407] Connection header received
0806 15:08:05.683655 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.683656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.683669 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.683739 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.684688 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.685457 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.687163 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.687450 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.687542 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.688908 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.688909 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.688909 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.688916 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.690668 (+ 1752us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.691071 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.691072 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.691072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.691138 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.691338 (+ 200us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.691340 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.691340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.691460 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.691568 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.691668 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.691745 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:08:05.692196 5143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:05.683434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35718 (local address 127.29.69.189:43385)
0806 15:08:05.683487 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:05.683489 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:05.683666 (+ 177us) server_negotiation.cc:407] Connection header received
0806 15:08:05.683810 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:05.683812 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:05.683828 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:05.683899 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:05.685018 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.685632 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.686747 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:05.687089 (+ 342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:05.687156 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:05.689172 (+ 2016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:05.689173 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:05.689174 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:05.689181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:05.690856 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.691283 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.691284 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.691285 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.691346 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:05.691576 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:05.691577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:05.691577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:05.691711 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:05.691783 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:05.692019 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 15:08:05.692109 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:08:05.720441 5185 ts_tablet_manager.cc:1918] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:05.720561 5185 log.cc:1196] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/1c1b73d43a7c4fe2a48aebeb5aa386a3
I20260806 15:08:05.720904 5185 ts_tablet_manager.cc:1939] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a4dbb895b58a4130807ca10cd207efc8: Deleting consensus metadata
W20260806 15:08:05.723979 4730 connection.cc:441] server connection from 127.0.0.1:56002 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56002 (request call id 1) could send its response
I20260806 15:08:05.752485 5186 ts_tablet_manager.cc:1918] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:05.752627 5186 log.cc:1196] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/1c1b73d43a7c4fe2a48aebeb5aa386a3
I20260806 15:08:05.752952 5186 ts_tablet_manager.cc:1939] T 1c1b73d43a7c4fe2a48aebeb5aa386a3 P a1d73c25e8f24b269c38185695dbfd6e: Deleting consensus metadata
W20260806 15:08:05.753412 4871 connection.cc:441] server connection from 127.0.0.1:56154 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:56154 (request call id 1) could send its response
I20260806 15:08:06.598726 5194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:06.598408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:58969)
0806 15:08:06.598568 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:06.598665 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
W20260806 15:08:06.599026 4989 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:46287 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:06.599588 5195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:06.599330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:45017)
0806 15:08:06.599439 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:06.599538 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":60,"threads_started":1}
W20260806 15:08:06.599787 4848 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:46287 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:06.600068 5197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:06.599812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:42067)
0806 15:08:06.599947 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:06.600014 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":73,"threads_started":1}
W20260806 15:08:06.600267 5129 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:46287 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:07.107159 5198 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9ba2c64bce64496b9ee66d3b9f0382b)
I20260806 15:08:07.107263 5198 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:07.107546 5198 leader_election.cc:288] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287), d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188:35147)
I20260806 15:08:07.107990 5199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.107697 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58852)
0806 15:08:07.107852 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.107926 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":80,"threads_started":1}
W20260806 15:08:07.108147 4456 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:07.108171 5203 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9ba2c64bce64496b9ee66d3b9f0382b)
I20260806 15:08:07.108386 5203 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:07.108647 5203 leader_election.cc:288] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287), 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189:43385)
I20260806 15:08:07.108955 5205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.108753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58874)
0806 15:08:07.108856 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.108907 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79,"thread_start_us":46,"threads_started":1}
I20260806 15:08:07.108982 5199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.108477 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58862)
0806 15:08:07.108912 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.108955 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417}
W20260806 15:08:07.109052 4456 leader_election.cc:334] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
W20260806 15:08:07.109229 4645 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:07.109635 5205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.109558 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58888)
0806 15:08:07.109588 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.109611 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260806 15:08:07.109788 4645 leader_election.cc:334] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:07.111434 5200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.107743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35147 (local address 127.0.0.1:38996)
0806 15:08:07.107917 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.107928 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:07.107994 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:07.108260 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:07.108261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:07.108263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:07.108329 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:07.108331 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.109292 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.109292 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:07.110542 (+ 1250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:07.110544 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.111150 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.111151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:07.111218 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:07.111222 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:08:07.111310 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 15:08:07.111355 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":45,"threads_started":1}
I20260806 15:08:07.111423 5201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.107921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38996 (local address 127.29.69.188:35147)
0806 15:08:07.108071 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:07.108073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:07.108093 (+ 20us) server_negotiation.cc:407] Connection header received
0806 15:08:07.108144 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:07.108144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:07.108155 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:07.108215 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:07.108401 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.109200 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.110618 (+ 1418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.111066 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.111149 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:07.111161 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:07.111318 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 15:08:07.111362 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260806 15:08:07.112500 5207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.109025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35724 (local address 127.29.69.189:43385)
0806 15:08:07.109163 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:07.109165 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:07.109231 (+ 66us) server_negotiation.cc:407] Connection header received
0806 15:08:07.109291 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:07.109292 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:07.109302 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:07.109365 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:07.109530 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.110331 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.111837 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.112190 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.112246 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:07.112253 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:07.112428 (+ 175us) server_negotiation.cc:299] Negotiation successful
0806 15:08:07.112459 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":75,"threads_started":1}
I20260806 15:08:07.112574 5206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.108896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:43385 (local address 127.0.0.1:35724)
0806 15:08:07.109146 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.109157 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:07.109240 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:07.109381 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:07.109381 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:07.109384 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:07.109435 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:07.109437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.110401 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.110402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:07.111716 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:07.111719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:07.112269 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:07.112270 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:07.112356 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:07.112361 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:08:07.112418 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 15:08:07.112468 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":49,"threads_started":1}
I20260806 15:08:07.112871 4481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" is_pre_election: true
I20260806 15:08:07.113011 4481 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c2766f3b9b4c7f81ed0f88c1c00971 in term 1.
I20260806 15:08:07.112969 4673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" is_pre_election: true
I20260806 15:08:07.113091 4673 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3d7abb0686e3468eb5a1dd8edb83ea60 in term 1.
I20260806 15:08:07.113394 4455 leader_election.cc:302] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d7abb0686e3468eb5a1dd8edb83ea60, d1c2766f3b9b4c7f81ed0f88c1c00971; no voters: e9ba2c64bce64496b9ee66d3b9f0382b
I20260806 15:08:07.113540 5198 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 15:08:07.113592 5198 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9ba2c64bce64496b9ee66d3b9f0382b)
I20260806 15:08:07.113412 4645 leader_election.cc:302] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3d7abb0686e3468eb5a1dd8edb83ea60, d1c2766f3b9b4c7f81ed0f88c1c00971; no voters: e9ba2c64bce64496b9ee66d3b9f0382b
I20260806 15:08:07.113620 5198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:08:07.113703 5203 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260806 15:08:07.113765 5203 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9ba2c64bce64496b9ee66d3b9f0382b)
I20260806 15:08:07.113796 5203 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:08:07.114480 5198 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:07.114639 5198 leader_election.cc:288] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 2 election: Requested vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287), d1c2766f3b9b4c7f81ed0f88c1c00971 (127.29.69.188:35147)
I20260806 15:08:07.114859 5200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.114766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58898)
0806 15:08:07.114800 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.114829 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260806 15:08:07.114878 4673 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971"
I20260806 15:08:07.114904 5203 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:07.115084 4673 raft_consensus.cc:2379] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3d7abb0686e3468eb5a1dd8edb83ea60 in current term 2: Already voted for candidate d1c2766f3b9b4c7f81ed0f88c1c00971 in this term.
I20260806 15:08:07.115100 5203 leader_election.cc:288] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 2 election: Requested vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287), 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189:43385)
I20260806 15:08:07.115317 5206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.115222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58902)
0806 15:08:07.115259 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.115288 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260806 15:08:07.115345 5200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.115269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58908)
0806 15:08:07.115304 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.115322 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 15:08:07.115396 4481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
W20260806 15:08:07.115404 4456 leader_election.cc:334] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:07.115504 4456 leader_election.cc:302] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3d7abb0686e3468eb5a1dd8edb83ea60; no voters: d1c2766f3b9b4c7f81ed0f88c1c00971, e9ba2c64bce64496b9ee66d3b9f0382b
I20260806 15:08:07.115510 4481 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate d1c2766f3b9b4c7f81ed0f88c1c00971 in current term 2: Already voted for candidate 3d7abb0686e3468eb5a1dd8edb83ea60 in this term.
I20260806 15:08:07.115610 5198 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 15:08:07.115883 5206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.115794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:58922)
0806 15:08:07.115842 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.115867 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 15:08:07.116053 4645 leader_election.cc:334] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:07.116112 4645 leader_election.cc:302] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d1c2766f3b9b4c7f81ed0f88c1c00971; no voters: 3d7abb0686e3468eb5a1dd8edb83ea60, e9ba2c64bce64496b9ee66d3b9f0382b
I20260806 15:08:07.116207 5203 raft_consensus.cc:2726] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260806 15:08:07.599704 5209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.599421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:51367)
0806 15:08:07.599576 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.599639 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":99,"threads_started":1}
I20260806 15:08:07.600282 5210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.600051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:60599)
0806 15:08:07.600174 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.600211 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":74,"threads_started":1}
I20260806 15:08:07.600811 5211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:07.600601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:51109)
0806 15:08:07.600730 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:07.600767 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260806 15:08:08.600610 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.600362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:34923)
0806 15:08:08.600496 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.600548 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260806 15:08:08.600888 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.600672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:39487)
0806 15:08:08.600798 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.600838 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":57,"threads_started":1}
I20260806 15:08:08.601397 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.601174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:60207)
0806 15:08:08.601290 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.601328 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":49,"threads_started":1}
I20260806 15:08:08.928172 5215 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:08.928278 5215 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:08.928550 5215 leader_election.cc:288] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287), 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189:43385)
I20260806 15:08:08.928961 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.928753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:37620)
0806 15:08:08.928867 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.928911 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":69,"threads_started":1}
I20260806 15:08:08.929055 4481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" is_pre_election: true
I20260806 15:08:08.929176 4481 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d1c2766f3b9b4c7f81ed0f88c1c00971 in term 2.
I20260806 15:08:08.929371 4645 leader_election.cc:302] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d7abb0686e3468eb5a1dd8edb83ea60, d1c2766f3b9b4c7f81ed0f88c1c00971; no voters:
I20260806 15:08:08.929473 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.929319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:37624)
0806 15:08:08.929386 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.929426 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 15:08:08.929502 5215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260806 15:08:08.929535 5215 raft_consensus.cc:482] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260806 15:08:08.929545 4645 leader_election.cc:334] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:08.929612 5215 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 2 FOLLOWER]: Advancing to term 3
I20260806 15:08:08.930428 5215 raft_consensus.cc:504] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:08.930562 5215 leader_election.cc:288] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 3 election: Requested vote from peers e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287), 3d7abb0686e3468eb5a1dd8edb83ea60 (127.29.69.189:43385)
I20260806 15:08:08.930754 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.930666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:37628)
0806 15:08:08.930700 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.930728 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260806 15:08:08.930859 4481 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60"
I20260806 15:08:08.930968 4481 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 2 FOLLOWER]: Advancing to term 3
I20260806 15:08:08.931680 4481 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d1c2766f3b9b4c7f81ed0f88c1c00971 in term 3.
I20260806 15:08:08.931844 4645 leader_election.cc:302] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d7abb0686e3468eb5a1dd8edb83ea60, d1c2766f3b9b4c7f81ed0f88c1c00971; no voters:
I20260806 15:08:08.931941 5215 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 15:08:08.932050 5215 raft_consensus.cc:686] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [term 3 LEADER]: Becoming Leader. State: Replica: d1c2766f3b9b4c7f81ed0f88c1c00971, State: Running, Role: LEADER
I20260806 15:08:08.932117 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.931995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:37638)
0806 15:08:08.932045 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.932078 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 15:08:08.932191 4645 leader_election.cc:334] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
I20260806 15:08:08.932125 5215 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } }
I20260806 15:08:08.932559 5218 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1c2766f3b9b4c7f81ed0f88c1c00971. Latest consensus state: current_term: 3 leader_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:08.932641 5218 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:08.932808 5220 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:08.933179 5220 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:08.933238 5220 catalog_manager.cc:1259] Loaded cluster ID: a1951d064150421e97e8733849ab84ea
I20260806 15:08:08.933254 5220 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:08.933406 5220 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:08.933458 5220 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Loaded TSK: 0
I20260806 15:08:08.933565 5220 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:08:08.937186 4661 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38984:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:08:08.938758 4661 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:08.939729 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.939641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:37664)
0806 15:08:08.939685 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.939711 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 15:08:08.939848 4481 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [term 3 FOLLOWER]: Refusing update from remote peer d1c2766f3b9b4c7f81ed0f88c1c00971: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260806 15:08:08.940111 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.940005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.0.0.1:37668)
0806 15:08:08.940035 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.940086 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260806 15:08:08.940182 4645 consensus_peers.cc:487] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 -> Peer e9ba2c64bce64496b9ee66d3b9f0382b (127.29.69.190:46287): Couldn't send request to peer e9ba2c64bce64496b9ee66d3b9f0382b. Status: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260806 15:08:08.940919 5215 consensus_queue.cc:1035] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260806 15:08:08.941499 5222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1c2766f3b9b4c7f81ed0f88c1c00971. Latest consensus state: current_term: 3 leader_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:08.941593 5222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:08:08.942111 5221 mvcc.cc:205] Tried to move back new op lower bound from 7315574329095069696 to 7315574329066721280. Current Snapshot: MvccSnapshot[applied={T|T < 7315574329095069696}]
I20260806 15:08:08.942202 5215 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:08.942291 5215 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:08.942359 5222 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" committed_config { opid_index: 12 OBSOLETE_local: true peers { permanent_uuid: "e9ba2c64bce64496b9ee66d3b9f0382b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46287 } } peers { permanent_uuid: "3d7abb0686e3468eb5a1dd8edb83ea60" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 43385 } attrs { promote: false } } peers { permanent_uuid: "d1c2766f3b9b4c7f81ed0f88c1c00971" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35147 } attrs { promote: false } } }
I20260806 15:08:08.942453 5222 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d7abb0686e3468eb5a1dd8edb83ea60 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:08:08.947937 5228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.944290 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39770 (local address 127.29.69.130:38231)
0806 15:08:08.944447 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:08.944450 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:08.944595 (+ 145us) server_negotiation.cc:407] Connection header received
0806 15:08:08.944699 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:08.944700 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:08.944710 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:08.944758 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:08.944955 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.945730 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.946979 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.947582 (+ 603us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.947654 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:08.947667 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:08.947814 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 15:08:08.947860 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":61,"threads_started":1}
I20260806 15:08:08.947938 5229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.944220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:38231 (local address 127.0.0.1:39770)
0806 15:08:08.944521 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.944531 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:08.944619 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:08.944829 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:08.944830 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:08.944832 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:08.944897 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:08.944899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.945815 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.945816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:08.946900 (+ 1084us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:08.946903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.947670 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.947671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:08.947733 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:08.947738 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:08:08.947800 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 15:08:08.947848 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283}
I20260806 15:08:08.948349 4920 tablet_service.cc:1467] Processing CreateTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba (DEFAULT_TABLE table=test-table [id=13edd772b981476487c89069fc485371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:08.948503 4920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab8f33256a4a4a5b8afed44945dc67ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:08.948954 5216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.944274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:41331 (local address 127.0.0.1:35712)
0806 15:08:08.944519 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.944530 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:08.944584 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:08.945999 (+ 1415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:08.946000 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:08.946002 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:08.946037 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:08.946038 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.946978 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.946979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:08.947803 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:08.947805 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.948706 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.948707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:08.948774 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:08.948777 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:08.948829 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 15:08:08.948867 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":82,"threads_started":1}
I20260806 15:08:08.949056 5230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.944388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:38687 (local address 127.0.0.1:51610)
0806 15:08:08.945516 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.945527 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:08.945608 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:08.945796 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:08.945797 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:08.945799 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:08.945849 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:08.945851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.947015 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.947016 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:08.948103 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:08.948106 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.948830 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.948831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:08.948885 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:08.948888 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:08.948940 (+ 52us) client_negotiation.cc:240] Negotiation successful
0806 15:08:08.948975 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1104,"thread_start_us":93,"threads_started":1}
I20260806 15:08:08.949075 5231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.944717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51610 (local address 127.29.69.129:38687)
0806 15:08:08.944841 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:08.944843 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:08.945662 (+ 819us) server_negotiation.cc:407] Connection header received
0806 15:08:08.945697 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:08.945698 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:08.945706 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:08.945780 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:08.945940 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.946762 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.948210 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.948747 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.948822 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:08.948834 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:08.948957 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 15:08:08.949001 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
I20260806 15:08:08.949342 4778 tablet_service.cc:1467] Processing CreateTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba (DEFAULT_TABLE table=test-table [id=13edd772b981476487c89069fc485371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:08.949469 4778 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab8f33256a4a4a5b8afed44945dc67ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:08.949977 5232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.945478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35712 (local address 127.29.69.131:41331)
0806 15:08:08.945863 (+ 385us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:08.945866 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:08.945874 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:08.945900 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:08.945901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:08.945913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:08.945983 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:08.946117 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.946855 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.948071 (+ 1216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:08.948608 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:08.948704 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:08.948716 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:08.949883 (+ 1167us) server_negotiation.cc:299] Negotiation successful
0806 15:08:08.949925 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":362,"thread_start_us":109,"threads_started":1}
I20260806 15:08:08.950214 5233 tablet_bootstrap.cc:492] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: Bootstrap starting.
I20260806 15:08:08.950230 5059 tablet_service.cc:1467] Processing CreateTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba (DEFAULT_TABLE table=test-table [id=13edd772b981476487c89069fc485371]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:08.950399 5059 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ab8f33256a4a4a5b8afed44945dc67ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:08.950626 5233 tablet_bootstrap.cc:654] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:08.951287 5233 tablet_bootstrap.cc:492] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: No bootstrap required, opened a new log
I20260806 15:08:08.951357 5233 ts_tablet_manager.cc:1397] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:08.951411 5235 tablet_bootstrap.cc:492] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8: Bootstrap starting.
I20260806 15:08:08.951472 5233 raft_consensus.cc:348] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:08.951594 5233 raft_consensus.cc:374] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:08.951625 5233 raft_consensus.cc:729] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1d73c25e8f24b269c38185695dbfd6e, State: Initialized, Role: FOLLOWER
I20260806 15:08:08.951704 5233 consensus_queue.cc:260] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:08.951753 5235 tablet_bootstrap.cc:654] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:08.951889 5233 ts_tablet_manager.cc:1428] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:08.952047 5237 tablet_bootstrap.cc:492] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Bootstrap starting.
I20260806 15:08:08.952325 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.952202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:34069)
0806 15:08:08.952266 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.952301 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 15:08:08.952544 5237 tablet_bootstrap.cc:654] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:08.952700 4988 heartbeater.cc:503] Master 127.29.69.188:35147 was elected leader, sending a full tablet report...
I20260806 15:08:08.952812 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.952720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:34483)
0806 15:08:08.952754 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.952783 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260806 15:08:08.953436 5235 tablet_bootstrap.cc:492] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8: No bootstrap required, opened a new log
I20260806 15:08:08.953501 5235 ts_tablet_manager.cc:1397] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:08:08.953579 5237 tablet_bootstrap.cc:492] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: No bootstrap required, opened a new log
I20260806 15:08:08.953627 5237 ts_tablet_manager.cc:1397] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:08:08.953641 5235 raft_consensus.cc:348] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:08.953722 5235 raft_consensus.cc:374] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:08.953743 5235 raft_consensus.cc:729] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4dbb895b58a4130807ca10cd207efc8, State: Initialized, Role: FOLLOWER
I20260806 15:08:08.953791 5235 consensus_queue.cc:260] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:08.953821 5237 raft_consensus.cc:348] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:08.953926 5237 raft_consensus.cc:374] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:08.953959 5237 raft_consensus.cc:729] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de0b9952227e4b0f82502b9b07dc61aa, State: Initialized, Role: FOLLOWER
I20260806 15:08:08.953962 5235 ts_tablet_manager.cc:1428] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:08.954034 5237 consensus_queue.cc:260] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:08.954222 5237 ts_tablet_manager.cc:1428] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:08.954324 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.954203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:34375)
0806 15:08:08.954238 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.954271 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260806 15:08:08.954694 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.954565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:36703)
0806 15:08:08.954633 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.954662 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 15:08:08.954743 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.954622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:55493)
0806 15:08:08.954692 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.954718 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 15:08:08.955305 5128 heartbeater.cc:503] Master 127.29.69.188:35147 was elected leader, sending a full tablet report...
I20260806 15:08:08.955564 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:08.955478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:52251)
0806 15:08:08.955515 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:08.955539 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260806 15:08:08.968171 5131 tablet.cc:2369] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:08:09.014405 5240 raft_consensus.cc:482] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:09.014595 5240 raft_consensus.cc:504] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:09.014889 5240 leader_election.cc:288] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231), de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:09.015215 5080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab8f33256a4a4a5b8afed44945dc67ba" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de0b9952227e4b0f82502b9b07dc61aa" is_pre_election: true
I20260806 15:08:09.015246 4940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab8f33256a4a4a5b8afed44945dc67ba" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d73c25e8f24b269c38185695dbfd6e" is_pre_election: true
I20260806 15:08:09.015336 5080 raft_consensus.cc:2454] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 0.
I20260806 15:08:09.015336 4940 raft_consensus.cc:2454] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 0.
I20260806 15:08:09.015501 4733 leader_election.cc:302] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4dbb895b58a4130807ca10cd207efc8, de0b9952227e4b0f82502b9b07dc61aa; no voters:
I20260806 15:08:09.015647 5240 raft_consensus.cc:2781] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:09.015700 5240 raft_consensus.cc:482] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:09.015733 5240 raft_consensus.cc:3037] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:09.016479 5240 raft_consensus.cc:504] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:09.016631 5240 leader_election.cc:288] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 election: Requested vote from peers a1d73c25e8f24b269c38185695dbfd6e (127.29.69.130:38231), de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331)
I20260806 15:08:09.016819 5080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab8f33256a4a4a5b8afed44945dc67ba" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "de0b9952227e4b0f82502b9b07dc61aa"
I20260806 15:08:09.016819 4940 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ab8f33256a4a4a5b8afed44945dc67ba" candidate_uuid: "a4dbb895b58a4130807ca10cd207efc8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1d73c25e8f24b269c38185695dbfd6e"
I20260806 15:08:09.016901 5080 raft_consensus.cc:3037] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:09.016921 4940 raft_consensus.cc:3037] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:09.017522 5080 raft_consensus.cc:2454] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 1.
I20260806 15:08:09.017617 4940 raft_consensus.cc:2454] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4dbb895b58a4130807ca10cd207efc8 in term 1.
I20260806 15:08:09.017691 4733 leader_election.cc:302] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4dbb895b58a4130807ca10cd207efc8, de0b9952227e4b0f82502b9b07dc61aa; no voters:
I20260806 15:08:09.017788 5240 raft_consensus.cc:2781] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:09.017985 5240 raft_consensus.cc:686] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 1 LEADER]: Becoming Leader. State: Replica: a4dbb895b58a4130807ca10cd207efc8, State: Running, Role: LEADER
I20260806 15:08:09.018082 4847 heartbeater.cc:503] Master 127.29.69.188:35147 was elected leader, sending a full tablet report...
I20260806 15:08:09.018062 5240 consensus_queue.cc:237] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } }
I20260806 15:08:09.018388 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.018236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:38973)
0806 15:08:09.018281 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.018352 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260806 15:08:09.018952 4661 catalog_manager.cc:5495] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "a4dbb895b58a4130807ca10cd207efc8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4dbb895b58a4130807ca10cd207efc8" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 38687 } health_report { overall_health: HEALTHY } } }
I20260806 15:08:09.042809 5231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.040507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51616 (local address 127.29.69.129:38687)
0806 15:08:09.040571 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:09.040573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:09.040580 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:09.040631 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:09.040632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:09.040641 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:09.040680 (+ 39us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:09.040832 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:09.041323 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:09.042115 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:09.042384 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:09.042440 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:09.042578 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:09.042606 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:09.042644 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:09.042692 (+ 48us) server_negotiation.cc:299] Negotiation successful
0806 15:08:09.042712 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:08:09.043721 5080 raft_consensus.cc:1261] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Refusing update from remote peer a4dbb895b58a4130807ca10cd207efc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:09.043751 4940 raft_consensus.cc:1261] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Refusing update from remote peer a4dbb895b58a4130807ca10cd207efc8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:09.043936 5242 consensus_queue.cc:1035] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de0b9952227e4b0f82502b9b07dc61aa" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 41331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:09.044039 5240 consensus_queue.cc:1035] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1d73c25e8f24b269c38185695dbfd6e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:09.044757 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.044655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:40279)
0806 15:08:09.044697 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.044726 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 15:08:09.045243 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.045045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:38675)
0806 15:08:09.045171 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.045204 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108}
I20260806 15:08:09.045740 5245 mvcc.cc:205] Tried to move back new op lower bound from 7315574329521278976 to 7315574329418407936. Current Snapshot: MvccSnapshot[applied={T|T < 7315574329521278976}]
I20260806 15:08:09.046190 5212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.046093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.130:50587)
0806 15:08:09.046131 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.046158 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260806 15:08:09.046373 5246 mvcc.cc:205] Tried to move back new op lower bound from 7315574329521278976 to 7315574329418407936. Current Snapshot: MvccSnapshot[applied={T|T < 7315574329521278976}]
I20260806 15:08:09.046571 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.046409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:37009)
0806 15:08:09.046506 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.046535 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260806 15:08:09.047148 4661 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:09.047240 4661 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38984:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:09.047349 5213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.047227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.129:57407)
0806 15:08:09.047293 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.047319 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260806 15:08:09.047770 5214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.047671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46287 (local address 127.29.69.131:46135)
0806 15:08:09.047705 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.047738 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:46287: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":19}
I20260806 15:08:09.048800 4661 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d1c2766f3b9b4c7f81ed0f88c1c00971: Sending DeleteTablet for 3 replicas of tablet ab8f33256a4a4a5b8afed44945dc67ba
I20260806 15:08:09.049028 5059 tablet_service.cc:1514] Processing DeleteTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:09 UTC) from {username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:35712
I20260806 15:08:09.049079 4920 tablet_service.cc:1514] Processing DeleteTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:09 UTC) from {username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:39770
I20260806 15:08:09.049189 4778 tablet_service.cc:1514] Processing DeleteTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:09 UTC) from {username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:51610
I20260806 15:08:09.049245 5256 tablet_replica.cc:330] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: stopping tablet replica
I20260806 15:08:09.049304 5256 raft_consensus.cc:2229] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:09.049351 5256 raft_consensus.cc:2258] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:09.049371 5257 tablet_replica.cc:330] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8: stopping tablet replica
I20260806 15:08:09.049499 5257 raft_consensus.cc:2229] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:09.049516 5254 tablet_replica.cc:330] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: stopping tablet replica
I20260806 15:08:09.049527 5059 tablet_service.cc:1514] Processing DeleteTablet for tablet ab8f33256a4a4a5b8afed44945dc67ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:09 UTC) from {username='oryx', principal='oryx/127.29.69.188@KRBTEST.COM'} at 127.0.0.1:35712
I20260806 15:08:09.049566 5257 raft_consensus.cc:2258] T ab8f33256a4a4a5b8afed44945dc67ba P a4dbb895b58a4130807ca10cd207efc8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:09.049576 5254 raft_consensus.cc:2229] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:09.049619 5254 raft_consensus.cc:2258] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:09.049707 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4622
I20260806 15:08:09.051517 5254 ts_tablet_manager.cc:1905] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:09.053133 5254 ts_tablet_manager.cc:1918] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:09.053195 5254 log.cc:1196] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/ab8f33256a4a4a5b8afed44945dc67ba
I20260806 15:08:09.053453 5254 ts_tablet_manager.cc:1939] T ab8f33256a4a4a5b8afed44945dc67ba P de0b9952227e4b0f82502b9b07dc61aa: Deleting consensus metadata
I20260806 15:08:09.053727 4647 catalog_manager.cc:4841] TS de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331): tablet ab8f33256a4a4a5b8afed44945dc67ba (table test-table [id=13edd772b981476487c89069fc485371]) successfully deleted
W20260806 15:08:09.053860 4647 catalog_manager.cc:4808] TS de0b9952227e4b0f82502b9b07dc61aa (127.29.69.131:41331): delete failed for tablet ab8f33256a4a4a5b8afed44945dc67ba because the tablet was not found. No further retry: Not found: Tablet not found: ab8f33256a4a4a5b8afed44945dc67ba
I20260806 15:08:09.059043 5256 ts_tablet_manager.cc:1905] T ab8f33256a4a4a5b8afed44945dc67ba P a1d73c25e8f24b269c38185695dbfd6e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 15:08:09.059751 5230 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:09.059568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:38687 (local address 127.0.0.1:51622)
0806 15:08:09.059611 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.059622 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:09.059659 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:09.059704 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:38687: BlockingWrite error: write error: Connection reset by peer (error 104)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 15:08:09.059890 4645 catalog_manager.cc:4584] TS a4dbb895b58a4130807ca10cd207efc8 (127.29.69.129:38687): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet ab8f33256a4a4a5b8afed44945dc67ba: Network error: Client connection negotiation failed: client connection to 127.29.69.129:38687: BlockingWrite error: write error: Connection reset by peer (error 104)
I20260806 15:08:09.060019 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4855
I20260806 15:08:09.065943 5230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:09.065805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:38231 (local address 127.0.0.1:39786)
0806 15:08:09.065863 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:09.065902 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.130:38231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:08:09.066036 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4995
I20260806 15:08:09.071156 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4334
I20260806 15:08:09.077262 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 4527
2026-08-06T15:08:09Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6353 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:09 dist-test-slave-tm1g krb5kdc[5260](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:09 dist-test-slave-tm1g krb5kdc[5260](info): set up 2 sockets
Aug 06 15:08:09 dist-test-slave-tm1g krb5kdc[5260](info): commencing operation
krb5kdc: starting...
W20260806 15:08:10.141040 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:10Z Disabled control of system clock
WARNING: no policy specified for oryx/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab.
Entry for principal oryx/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab.
I20260806 15:08:10.254546 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35899
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab
--principal=oryx/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:35899
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:10.340422 5273 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:10.340624 5273 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:10.340647 5273 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:10.341722 5273 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:10.341753 5273 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260806 15:08:10.341766 5273 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:10.341780 5273 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:10.341792 5273 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:10.341804 5273 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:10.343330 5273 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:35899
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.190.keytab
--principal=oryx/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35899
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5273
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:10.343524 5273 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:10.343698 5273 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:10.348486 5279 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.348449 5282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.348510 5280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:10.348747 5273 server_base.cc:1034] running on GCE node
I20260806 15:08:10.349004 5273 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:10.349314 5273 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:10.350482 5273 hybrid_clock.cc:648] HybridClock initialized: now 1786028890350473 us; error 40 us; skew 500 ppm
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:10.352875 5273 init.cc:377] Logged in from keytab as oryx/127.29.69.190@KRBTEST.COM (short username oryx)
I20260806 15:08:10.353302 5273 webserver.cc:460] Webserver started at http://127.29.69.190:38615/ using document root <none> and password file <none>
I20260806 15:08:10.353557 5273 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:10.353628 5273 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:10.353777 5273 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:10.354878 5273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "c83a26091d6e4157b8128d6940fa46eb"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "e03ebda16cbd48ee3a31fe2ccf37420f"
server_key_iv: "e791693a4fa659adab226b502361be51"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.355242 5273 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "c83a26091d6e4157b8128d6940fa46eb"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "e03ebda16cbd48ee3a31fe2ccf37420f"
server_key_iv: "e791693a4fa659adab226b502361be51"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.356588 5273 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:10.357354 5289 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.357524 5273 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:10.357633 5273 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "c83a26091d6e4157b8128d6940fa46eb"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "e03ebda16cbd48ee3a31fe2ccf37420f"
server_key_iv: "e791693a4fa659adab226b502361be51"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.357707 5273 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:10.373366 5273 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:10.375284 5273 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:10.375456 5273 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:10.380010 5273 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:35899
I20260806 15:08:10.380115 5353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:35899 every 8 connection(s)
I20260806 15:08:10.380425 5273 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:10.381129 5354 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:10.383322 5354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Bootstrap starting.
I20260806 15:08:10.383888 5354 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:10.384135 5354 log.cc:824] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:10.384768 5354 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: No bootstrap required, opened a new log
I20260806 15:08:10.386896 5354 raft_consensus.cc:348] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c83a26091d6e4157b8128d6940fa46eb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35899 } }
I20260806 15:08:10.387028 5354 raft_consensus.cc:374] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:10.387050 5354 raft_consensus.cc:729] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c83a26091d6e4157b8128d6940fa46eb, State: Initialized, Role: FOLLOWER
I20260806 15:08:10.387178 5354 consensus_queue.cc:260] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c83a26091d6e4157b8128d6940fa46eb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35899 } }
I20260806 15:08:10.387261 5354 raft_consensus.cc:388] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:10.387285 5354 raft_consensus.cc:482] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:10.387312 5354 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:10.387791 5354 raft_consensus.cc:504] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c83a26091d6e4157b8128d6940fa46eb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35899 } }
I20260806 15:08:10.387874 5354 leader_election.cc:302] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c83a26091d6e4157b8128d6940fa46eb; no voters:
I20260806 15:08:10.388025 5354 leader_election.cc:288] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:10.388064 5357 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:10.388186 5357 raft_consensus.cc:686] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [term 1 LEADER]: Becoming Leader. State: Replica: c83a26091d6e4157b8128d6940fa46eb, State: Running, Role: LEADER
I20260806 15:08:10.388288 5354 sys_catalog.cc:564] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:10.388303 5357 consensus_queue.cc:237] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c83a26091d6e4157b8128d6940fa46eb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35899 } }
I20260806 15:08:10.388630 5357 sys_catalog.cc:455] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader c83a26091d6e4157b8128d6940fa46eb. Latest consensus state: current_term: 1 leader_uuid: "c83a26091d6e4157b8128d6940fa46eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c83a26091d6e4157b8128d6940fa46eb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35899 } } }
I20260806 15:08:10.388809 5357 sys_catalog.cc:458] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:10.388644 5359 sys_catalog.cc:455] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c83a26091d6e4157b8128d6940fa46eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c83a26091d6e4157b8128d6940fa46eb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35899 } } }
I20260806 15:08:10.388971 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 5273
I20260806 15:08:10.389031 5363 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:10.389074 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:10.389062 5359 sys_catalog.cc:458] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:10.389271 29974 external_mini_cluster.cc:1428] Setting key ca14978b469762c4101bd406e51d6825
I20260806 15:08:10.389528 5363 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:10.391104 5363 catalog_manager.cc:1347] Generated new cluster ID: e7b3cf247faf493188ac018b85798a5b
I20260806 15:08:10.391156 5363 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:10.399340 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.389928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36828 (local address 127.29.69.190:35899)
0806 15:08:10.390105 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.390115 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.390406 (+ 291us) server_negotiation.cc:407] Connection header received
0806 15:08:10.390557 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.390571 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.390642 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.390783 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.391611 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.392504 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.393290 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.393715 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.393830 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.396114 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.396117 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.396117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.396127 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.397738 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.398122 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.398125 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.398125 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.398214 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.398454 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.398455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.398455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.398684 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.398860 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.398941 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.399183 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":71,"threads_started":1}
I20260806 15:08:10.416679 5363 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:10.417387 5363 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:10.419795 5363 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Generated new TSK 0
I20260806 15:08:10.419966 5363 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab.
Entry for principal oryx/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab.
I20260806 15:08:10.447297 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35899
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:10.528188 5380 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:10.528416 5380 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:10.528457 5380 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:10.529610 5380 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:10.529673 5380 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:10.529711 5380 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:08:10.529768 5380 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:10.531313 5380 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:35899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5380
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:10.531574 5380 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:10.531800 5380 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:10.536613 5385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.536617 5386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.536631 5388 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:10.536892 5380 server_base.cc:1034] running on GCE node
I20260806 15:08:10.537135 5380 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:10.537393 5380 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:10.538545 5380 hybrid_clock.cc:648] HybridClock initialized: now 1786028890538531 us; error 46 us; skew 500 ppm
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:10.540985 5380 init.cc:377] Logged in from keytab as oryx/127.29.69.129@KRBTEST.COM (short username oryx)
I20260806 15:08:10.541399 5380 webserver.cc:460] Webserver started at http://127.29.69.129:34077/ using document root <none> and password file <none>
I20260806 15:08:10.541644 5380 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:10.541733 5380 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:10.541889 5380 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:10.542956 5380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "196087b9e56e48c685fae455c8e355e2"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "f9b80f5e17bcf0ee9bda1fe73c2bce0a"
server_key_iv: "eb8a21ec2c78891e297ebc1f8c1c21de"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.543314 5380 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "196087b9e56e48c685fae455c8e355e2"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "f9b80f5e17bcf0ee9bda1fe73c2bce0a"
server_key_iv: "eb8a21ec2c78891e297ebc1f8c1c21de"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.544612 5380 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:10.545400 5395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.545579 5380 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:10.545677 5380 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "196087b9e56e48c685fae455c8e355e2"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "f9b80f5e17bcf0ee9bda1fe73c2bce0a"
server_key_iv: "eb8a21ec2c78891e297ebc1f8c1c21de"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.545761 5380 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:10.556069 5380 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:10.557826 5380 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:10.557981 5380 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:10.558531 5380 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:10.558591 5380 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.558635 5380 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:10.558660 5380 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.565827 5380 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:34465
I20260806 15:08:10.565901 5513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:34465 every 8 connection(s)
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:10.566246 5380 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:10.569262 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.558969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:41321 (local address 127.29.69.190:35899)
0806 15:08:10.559011 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.559014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.559236 (+ 222us) server_negotiation.cc:407] Connection header received
0806 15:08:10.559754 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.559756 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.559773 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.559851 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.560811 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.561692 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.563428 (+ 1736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.563798 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.563881 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.566721 (+ 2840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.566723 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.566723 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.566733 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.568190 (+ 1457us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.568530 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.568531 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.568531 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.568582 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.568783 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.568784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.568784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.568883 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.568940 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.569136 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.569200 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:08:10.569416 5404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.558971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.29.69.129:41321)
0806 15:08:10.559119 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.559152 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.559640 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.559961 (+ 321us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.559966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.560385 (+ 419us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:10.560700 (+ 315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.560707 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.561793 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.561795 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.563317 (+ 1522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.563321 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.563898 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.563900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.564074 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.564671 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:10.564681 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:10.566603 (+ 1922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:10.568261 (+ 1658us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.568265 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.568267 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.568464 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.568639 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.568640 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.568640 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.568731 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.568944 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:10.568948 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:10.569048 (+ 100us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.569126 (+ 78us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.569238 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":88,"threads_started":1}
I20260806 15:08:10.569975 5514 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35899
I20260806 15:08:10.570058 5514 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:10.570240 5514 heartbeater.cc:511] Master 127.29.69.190:35899 requested a full tablet report, sending...
I20260806 15:08:10.570849 5305 ts_manager.cc:194] Registered new tserver with Master: 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465)
I20260806 15:08:10.571712 5305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:41321
I20260806 15:08:10.572161 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 5380
I20260806 15:08:10.572274 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:10.572468 29974 external_mini_cluster.cc:1428] Setting key d39225743d96dac4b1f035cd1601e420
I20260806 15:08:10.576854 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.571147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:35077 (local address 127.29.69.190:35899)
0806 15:08:10.571186 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.571188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.571198 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:08:10.571219 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.571220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.571230 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.571292 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.571546 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.572244 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.573137 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.573399 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.573447 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.574449 (+ 1002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.574450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.574450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.574456 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.575778 (+ 1322us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.576078 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.576079 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.576079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.576136 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.576347 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.576348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.576349 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.576463 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.576535 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.576693 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.576766 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:08:10.576861 5520 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.570973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.29.69.129:35077)
0806 15:08:10.571114 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.571127 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.571179 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.571294 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.571295 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.571433 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:10.571481 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.571482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.572349 (+ 867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.572350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.573054 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.573057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.573469 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.573470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.573543 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.573920 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:10.573925 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:10.574368 (+ 443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:10.575834 (+ 1466us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.575835 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.575835 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.575992 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.576213 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.576214 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.576215 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.576273 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.576537 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:10.576539 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:10.576583 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.576668 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.576766 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for oryx/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab.
Entry for principal oryx/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab.
I20260806 15:08:10.597301 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35899
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:10.689787 5523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:10.690078 5523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:10.690138 5523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:10.692353 5523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:10.692410 5523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:10.692451 5523 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:08:10.692489 5523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:10.695269 5523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:35899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:10.695546 5523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:10.695832 5523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:10.702426 5529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.702443 5528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.702598 5531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:10.702629 5523 server_base.cc:1034] running on GCE node
I20260806 15:08:10.702838 5523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:10.703125 5523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:10.704291 5523 hybrid_clock.cc:648] HybridClock initialized: now 1786028890704270 us; error 46 us; skew 500 ppm
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:10.707602 5523 init.cc:377] Logged in from keytab as oryx/127.29.69.130@KRBTEST.COM (short username oryx)
I20260806 15:08:10.708027 5523 webserver.cc:460] Webserver started at http://127.29.69.130:33477/ using document root <none> and password file <none>
I20260806 15:08:10.708225 5523 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:10.708266 5523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:10.708352 5523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:10.709336 5523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "91d940a8e5be4ebba33701152124aee1"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "530c5f6088f2c19cc39bbdc32583f676"
server_key_iv: "905b98dedb0b0872a71332f3ba5fa65e"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.709641 5523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "91d940a8e5be4ebba33701152124aee1"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "530c5f6088f2c19cc39bbdc32583f676"
server_key_iv: "905b98dedb0b0872a71332f3ba5fa65e"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.710978 5523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:10.711655 5538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.711835 5523 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:10.711937 5523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "91d940a8e5be4ebba33701152124aee1"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "530c5f6088f2c19cc39bbdc32583f676"
server_key_iv: "905b98dedb0b0872a71332f3ba5fa65e"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.712023 5523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:10.727138 5523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:10.728901 5523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:10.729056 5523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:10.729542 5523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:10.729604 5523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.729667 5523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:10.729698 5523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:10.737279 5523 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:40531
I20260806 15:08:10.737360 5656 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:40531 every 8 connection(s)
I20260806 15:08:10.737692 5523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:10.740119 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.730084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:33357 (local address 127.29.69.190:35899)
0806 15:08:10.730162 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.730164 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.730407 (+ 243us) server_negotiation.cc:407] Connection header received
0806 15:08:10.731155 (+ 748us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.731156 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.731167 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.731228 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.732140 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.732655 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.734379 (+ 1724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.734611 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.734705 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.737345 (+ 2640us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.737347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.737347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.737354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.738971 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.739312 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.739313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.739313 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.739364 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.739592 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.739593 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.739593 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.739727 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.739779 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.739996 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.740057 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 15:08:10.740264 5547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.730067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.29.69.130:33357)
0806 15:08:10.730258 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.730322 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.731041 (+ 719us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.731308 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.731313 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.731704 (+ 391us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:10.732035 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.732042 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.732757 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.732758 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.734268 (+ 1510us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.734272 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.734736 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.734738 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.734850 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.735344 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:10.735354 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:10.737243 (+ 1889us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:10.739040 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.739045 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.739047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.739247 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.739424 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.739424 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.739425 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.739516 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.739777 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:10.739782 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:10.739897 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.739978 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.740088 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260806 15:08:10.740751 5657 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35899
I20260806 15:08:10.740849 5657 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:10.741027 5657 heartbeater.cc:511] Master 127.29.69.190:35899 requested a full tablet report, sending...
I20260806 15:08:10.741439 5305 ts_manager.cc:194] Registered new tserver with Master: 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531)
I20260806 15:08:10.741982 5305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:33357
I20260806 15:08:10.742163 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 5523
I20260806 15:08:10.742298 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:10.742542 29974 external_mini_cluster.cc:1428] Setting key 7926754aa2d8ebb6e9b197e90fa9dc5c
I20260806 15:08:10.747822 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.741857 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:38395 (local address 127.29.69.190:35899)
0806 15:08:10.741899 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.741901 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.742029 (+ 128us) server_negotiation.cc:407] Connection header received
0806 15:08:10.742052 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.742053 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.742063 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.742113 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.742515 (+ 402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.743042 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.743767 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.743971 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.744057 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.745212 (+ 1155us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.745213 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.745213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.745219 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.746654 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.747013 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.747014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.747015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.747072 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.747271 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.747272 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.747272 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.747418 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.747497 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.747658 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.747730 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:08:10.747836 5663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.741771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.29.69.130:38395)
0806 15:08:10.741911 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.741922 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.741982 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.742130 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.742131 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.742355 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:10.742433 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.742435 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.743142 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.743143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.743680 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.743682 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.744061 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.744062 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.744131 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.744584 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:10.744589 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:10.744984 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:10.746753 (+ 1769us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.746754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.746754 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.746928 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.747142 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.747143 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.747143 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.747208 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.747501 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:10.747503 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:10.747547 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.747632 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.747732 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for oryx/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab.
Entry for principal oryx/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab.
I20260806 15:08:10.766798 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35899
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40349
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:10.847908 5666 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:10.848109 5666 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:10.848134 5666 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:10.849326 5666 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:10.849366 5666 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:10.849386 5666 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260806 15:08:10.849404 5666 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:10.850878 5666 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40349
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.29.69.190:35899
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5666
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:10.851066 5666 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:10.851240 5666 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:10.856138 5672 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.856154 5671 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:10.856158 5674 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:10.856263 5666 server_base.cc:1034] running on GCE node
I20260806 15:08:10.856617 5666 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:10.856870 5666 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:10.858037 5666 hybrid_clock.cc:648] HybridClock initialized: now 1786028890858025 us; error 27 us; skew 500 ppm
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:10.860878 5666 init.cc:377] Logged in from keytab as oryx/127.29.69.131@KRBTEST.COM (short username oryx)
I20260806 15:08:10.861344 5666 webserver.cc:460] Webserver started at http://127.29.69.131:36011/ using document root <none> and password file <none>
I20260806 15:08:10.861615 5666 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:10.861661 5666 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:10.861811 5666 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:10.862913 5666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "40f46c82fb764ae0b887c4e967210c4a"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "6e2285b8e9f94b910ad18ee78520c24b"
server_key_iv: "93398c74554b5ec059e226dc87c64fd2"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.863281 5666 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "40f46c82fb764ae0b887c4e967210c4a"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "6e2285b8e9f94b910ad18ee78520c24b"
server_key_iv: "93398c74554b5ec059e226dc87c64fd2"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.864603 5666 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 15:08:10.865373 5681 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.865561 5666 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:10.865653 5666 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "40f46c82fb764ae0b887c4e967210c4a"
format_stamp: "Formatted at 2026-08-06 15:08:10 on dist-test-slave-tm1g"
server_key: "6e2285b8e9f94b910ad18ee78520c24b"
server_key_iv: "93398c74554b5ec059e226dc87c64fd2"
server_key_version: "encryptionkey@0"
I20260806 15:08:10.865725 5666 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:10.891224 5666 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:10.893575 5666 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:10.893759 5666 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:10.894348 5666 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:10.894416 5666 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:10.894451 5666 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:10.894483 5666 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:10.901458 5666 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:43927
I20260806 15:08:10.901803 5666 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:10.901959 5799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:43927 every 8 connection(s)
I20260806 15:08:10.904765 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.894800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:51509 (local address 127.29.69.190:35899)
0806 15:08:10.894839 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.894842 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.895067 (+ 225us) server_negotiation.cc:407] Connection header received
0806 15:08:10.895603 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.895604 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.895618 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.895672 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.896505 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.897328 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.899049 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.899389 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.899462 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.901876 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.901878 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.901878 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.901887 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.903379 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.903812 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.903813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.903814 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.903874 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.904127 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.904128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.904128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.904249 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.904325 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.904592 (+ 267us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.904675 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:08:10.904966 5690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.894792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.29.69.131:51509)
0806 15:08:10.894949 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.894983 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.895497 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.895752 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.895763 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.896099 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:10.896376 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.896382 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.897443 (+ 1061us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.897444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.898948 (+ 1504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.898952 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.899537 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.899538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.899670 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.900145 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:10.900152 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:10.901777 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:10.903489 (+ 1712us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.903496 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.903498 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.903722 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.903946 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.903947 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.903947 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.904058 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.904316 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:10.904323 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:10.904462 (+ 139us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.904568 (+ 106us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.904724 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":78,"threads_started":1}
I20260806 15:08:10.905498 5800 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35899
I20260806 15:08:10.905580 5800 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:10.905771 5800 heartbeater.cc:511] Master 127.29.69.190:35899 requested a full tablet report, sending...
I20260806 15:08:10.906160 5305 ts_manager.cc:194] Registered new tserver with Master: 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:10.906646 5305 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:51509
I20260806 15:08:10.911595 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 5666
I20260806 15:08:10.911623 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.906521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:48499 (local address 127.29.69.190:35899)
0806 15:08:10.906563 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.906565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.906690 (+ 125us) server_negotiation.cc:407] Connection header received
0806 15:08:10.906716 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.906717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.906728 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.906790 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.907142 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.907607 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.908311 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.908513 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.908586 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.909345 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.909347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.909347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.909354 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.910524 (+ 1170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.910866 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.910867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.910867 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.910923 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.911124 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.911125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.911126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.911229 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.911301 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.911458 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.911535 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:08:10.911645 5806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.906458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.29.69.131:48499)
0806 15:08:10.906619 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.906633 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.906681 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.906838 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.906839 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.907008 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:10.907058 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.907060 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.907701 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.907702 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.908214 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.908215 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.908586 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.908587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.908655 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.908997 (+ 342us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:10.909001 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:10.909257 (+ 256us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:10.910603 (+ 1346us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.910604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.910604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.910774 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.910994 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:10.910994 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:10.910995 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:10.911058 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:10.911294 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:10.911294 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:10.911347 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.911431 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.911545 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":76,"threads_started":1}
I20260806 15:08:10.911716 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:10.911922 29974 external_mini_cluster.cc:1428] Setting key 4408af92c3d361bb20fba4cdaf0ae861
I20260806 15:08:10.912900 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 15:08:10.933748 5372 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:10.928498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36834 (local address 127.29.69.190:35899)
0806 15:08:10.928566 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.928567 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.928575 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:10.928598 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.928599 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.928607 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.928658 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.929204 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.929695 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.930492 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.930677 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.930744 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.933649 (+ 2905us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36834: BlockingRecv error: recv got EOF from 127.0.0.1:36834 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 06 15:08:10 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:10.940680 5372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.934475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36838 (local address 127.29.69.190:35899)
0806 15:08:10.934524 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.934526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.934631 (+ 105us) server_negotiation.cc:407] Connection header received
0806 15:08:10.934657 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.934658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.934665 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.934707 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:10.935122 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.935574 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.936181 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.936348 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.936407 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.938388 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:10.938390 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:10.938390 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:10.938401 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:10.939747 (+ 1346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.940029 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.940030 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.940030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.940080 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:10.940223 (+ 143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:10.940223 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:10.940223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:10.940306 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:10.940390 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.940524 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.940609 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260806 15:08:10.942437 5306 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:08:10.943912 5306 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:10.950718 5826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.946459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40531 (local address 127.0.0.1:57512)
0806 15:08:10.946630 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.946640 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.946675 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.947240 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.947241 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.947242 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:10.947279 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.947280 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.948611 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.948612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.949607 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.949609 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.950461 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.950462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.950523 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.950528 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.950593 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.950634 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":2,"thread_start_us":70,"threads_started":1}
I20260806 15:08:10.950748 5827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.946665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57512 (local address 127.29.69.130:40531)
0806 15:08:10.946885 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.946890 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.946901 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:08:10.946939 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.946941 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.946958 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.947342 (+ 384us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:10.947411 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.948540 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.949690 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.950372 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.950447 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.950534 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.950609 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.950650 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":99,"threads_started":1}
I20260806 15:08:10.950842 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.946413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56256 (local address 127.29.69.131:43927)
0806 15:08:10.946612 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.946616 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.946627 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:08:10.946670 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.946672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.946689 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.946773 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:10.947030 (+ 257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.948269 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.949589 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.950243 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.950353 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.950441 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.950681 (+ 240us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.950730 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":82,"threads_started":1}
I20260806 15:08:10.950974 5822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.946188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:43927 (local address 127.0.0.1:56256)
0806 15:08:10.946471 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.946482 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.946536 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.946821 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.946825 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.946828 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:10.946889 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.946891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.948359 (+ 1468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.948360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.949494 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.949496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.950355 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.950356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.950470 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.950486 (+ 16us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.950558 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.950618 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":266,"mutex_wait_us":10,"thread_start_us":97,"threads_started":1}
I20260806 15:08:10.951807 5576 tablet_service.cc:1467] Processing CreateTablet for tablet 3464ac8ab6ea425e8963b9046b9f0187 (DEFAULT_TABLE table=test-table [id=3127e591339349cf8aad2a7c716f5189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:10.951781 5732 tablet_service.cc:1467] Processing CreateTablet for tablet 3464ac8ab6ea425e8963b9046b9f0187 (DEFAULT_TABLE table=test-table [id=3127e591339349cf8aad2a7c716f5189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:10.952173 5576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3464ac8ab6ea425e8963b9046b9f0187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:10.952176 5732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3464ac8ab6ea425e8963b9046b9f0187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:10.952245 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.946185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:34465 (local address 127.0.0.1:33186)
0806 15:08:10.946354 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:10.946399 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:10.946460 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:10.946969 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:10.946970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:10.946971 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:10.947027 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.947029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.948152 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.948153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.949494 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:10.949496 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.952036 (+ 2540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.952038 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:10.952102 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.952106 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:08:10.952138 (+ 32us) client_negotiation.cc:240] Negotiation successful
0806 15:08:10.952177 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":55,"threads_started":1}
I20260806 15:08:10.952673 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:10.946286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33186 (local address 127.29.69.129:34465)
0806 15:08:10.946793 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:10.946797 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:10.946806 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:08:10.946842 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:10.946844 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:10.946857 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:10.946959 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:10.947085 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.948042 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.950476 (+ 2434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:10.951932 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:10.952406 (+ 474us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:10.952490 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:10.952517 (+ 27us) server_negotiation.cc:299] Negotiation successful
0806 15:08:10.952563 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":473,"thread_start_us":99,"threads_started":1}
I20260806 15:08:10.953234 5447 tablet_service.cc:1467] Processing CreateTablet for tablet 3464ac8ab6ea425e8963b9046b9f0187 (DEFAULT_TABLE table=test-table [id=3127e591339349cf8aad2a7c716f5189]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:10.953589 5447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3464ac8ab6ea425e8963b9046b9f0187. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:10.955652 5828 tablet_bootstrap.cc:492] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Bootstrap starting.
I20260806 15:08:10.956068 5829 tablet_bootstrap.cc:492] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Bootstrap starting.
I20260806 15:08:10.956337 5828 tablet_bootstrap.cc:654] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:10.956648 5828 log.cc:824] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:10.956733 5829 tablet_bootstrap.cc:654] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:10.957077 5829 log.cc:824] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:10.957466 5832 tablet_bootstrap.cc:492] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Bootstrap starting.
I20260806 15:08:10.957576 5828 tablet_bootstrap.cc:492] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: No bootstrap required, opened a new log
I20260806 15:08:10.957650 5828 ts_tablet_manager.cc:1397] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:08:10.958096 5832 tablet_bootstrap.cc:654] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:10.958155 5829 tablet_bootstrap.cc:492] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: No bootstrap required, opened a new log
I20260806 15:08:10.958216 5829 ts_tablet_manager.cc:1397] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:08:10.958477 5832 log.cc:824] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:10.959263 5832 tablet_bootstrap.cc:492] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: No bootstrap required, opened a new log
I20260806 15:08:10.959332 5832 ts_tablet_manager.cc:1397] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:08:10.959457 5828 raft_consensus.cc:348] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:10.959609 5828 raft_consensus.cc:374] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:10.959654 5828 raft_consensus.cc:729] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d940a8e5be4ebba33701152124aee1, State: Initialized, Role: FOLLOWER
I20260806 15:08:10.959766 5828 consensus_queue.cc:260] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:10.960070 5657 heartbeater.cc:503] Master 127.29.69.190:35899 was elected leader, sending a full tablet report...
I20260806 15:08:10.960085 5828 ts_tablet_manager.cc:1428] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 15:08:10.960296 5829 raft_consensus.cc:348] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:10.960448 5829 raft_consensus.cc:374] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:10.960489 5829 raft_consensus.cc:729] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f46c82fb764ae0b887c4e967210c4a, State: Initialized, Role: FOLLOWER
I20260806 15:08:10.960628 5829 consensus_queue.cc:260] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:10.960892 5829 ts_tablet_manager.cc:1428] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 15:08:10.961052 5800 heartbeater.cc:503] Master 127.29.69.190:35899 was elected leader, sending a full tablet report...
I20260806 15:08:10.961381 5832 raft_consensus.cc:348] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:10.961557 5832 raft_consensus.cc:374] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:10.961597 5832 raft_consensus.cc:729] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Initialized, Role: FOLLOWER
I20260806 15:08:10.961704 5832 consensus_queue.cc:260] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:10.961984 5832 ts_tablet_manager.cc:1428] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 15:08:10.962085 5514 heartbeater.cc:503] Master 127.29.69.190:35899 was elected leader, sending a full tablet report...
W20260806 15:08:10.988458 5658 tablet.cc:2369] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:08:11.067075 5515 tablet.cc:2369] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:08:11.073223 5836 raft_consensus.cc:482] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:11.073328 5836 raft_consensus.cc:504] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:11.073669 5836 leader_election.cc:288] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927), 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531)
I20260806 15:08:11.076671 5825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.073969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:38177 (local address 127.29.69.131:43927)
0806 15:08:11.074038 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.074040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.074077 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:08:11.074180 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.074182 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.074191 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.074268 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:11.074458 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.074952 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.075922 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.076299 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.076396 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.076406 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.076564 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.076602 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 15:08:11.076764 5827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.074130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:42287 (local address 127.29.69.130:40531)
0806 15:08:11.074192 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.074194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.074277 (+ 83us) server_negotiation.cc:407] Connection header received
0806 15:08:11.074390 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.074391 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.074399 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.074473 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:11.074634 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.075105 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.076039 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.076411 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.076497 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.076505 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.076650 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.076689 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260806 15:08:11.076822 5838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.074049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40531 (local address 127.29.69.129:42287)
0806 15:08:11.074194 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.074204 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.074287 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.074476 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.074477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.074487 (+ 10us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:11.074562 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.074563 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.075188 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.075189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.075943 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.075944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.076502 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.076503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.076577 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.076581 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.076645 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.076686 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":54,"threads_started":1}
I20260806 15:08:11.076687 5837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.073837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:43927 (local address 127.29.69.129:38177)
0806 15:08:11.074001 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.074014 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.074099 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.074275 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.074276 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.074279 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:11.074373 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.074376 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.075041 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.075042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.075804 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.075806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.076394 (+ 588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.076395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.076469 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.076480 (+ 11us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.076555 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.076600 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260806 15:08:11.077198 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3464ac8ab6ea425e8963b9046b9f0187" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1" is_pre_election: true
I20260806 15:08:11.077244 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3464ac8ab6ea425e8963b9046b9f0187" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a" is_pre_election: true
I20260806 15:08:11.077355 5610 raft_consensus.cc:2454] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.077390 5754 raft_consensus.cc:2454] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.077596 5396 leader_election.cc:302] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 40f46c82fb764ae0b887c4e967210c4a; no voters:
I20260806 15:08:11.077754 5836 raft_consensus.cc:2781] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:11.077831 5836 raft_consensus.cc:482] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:11.077854 5836 raft_consensus.cc:3037] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.078680 5836 raft_consensus.cc:504] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:11.078814 5836 leader_election.cc:288] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Requested vote from peers 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927), 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531)
I20260806 15:08:11.078994 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3464ac8ab6ea425e8963b9046b9f0187" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a"
I20260806 15:08:11.079059 5754 raft_consensus.cc:3037] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.079049 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3464ac8ab6ea425e8963b9046b9f0187" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1"
I20260806 15:08:11.079139 5610 raft_consensus.cc:3037] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.079813 5754 raft_consensus.cc:2454] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.079942 5610 raft_consensus.cc:2454] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.079972 5396 leader_election.cc:302] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 40f46c82fb764ae0b887c4e967210c4a; no voters:
I20260806 15:08:11.080123 5836 raft_consensus.cc:2781] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:11.080265 5836 raft_consensus.cc:686] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Becoming Leader. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Running, Role: LEADER
I20260806 15:08:11.080375 5836 consensus_queue.cc:237] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } }
I20260806 15:08:11.081151 5305 catalog_manager.cc:5495] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196087b9e56e48c685fae455c8e355e2 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } health_report { overall_health: UNKNOWN } } }
I20260806 15:08:11.097036 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.094971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33194 (local address 127.29.69.129:34465)
0806 15:08:11.095032 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.095034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.095041 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:11.095072 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.095072 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.095088 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.095154 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:11.095268 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.095728 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.096424 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.096599 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.096648 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.096783 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.096872 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.096930 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.096964 (+ 34us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.096981 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 15:08:11.098863 5610 raft_consensus.cc:1261] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.098891 5754 raft_consensus.cc:1261] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.099207 5836 consensus_queue.cc:1035] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.099339 5839 consensus_queue.cc:1035] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.101680 5842 mvcc.cc:205] Tried to move back new op lower bound from 7315574337937727488 to 7315574337865826304. Current Snapshot: MvccSnapshot[applied={T|T < 7315574337937727488}]
I20260806 15:08:11.102347 5844 mvcc.cc:205] Tried to move back new op lower bound from 7315574337937727488 to 7315574337865826304. Current Snapshot: MvccSnapshot[applied={T|T < 7315574337937727488 or (T in {7315574337937727488})}]
I20260806 15:08:11.102450 5843 mvcc.cc:205] Tried to move back new op lower bound from 7315574337937727488 to 7315574337865826304. Current Snapshot: MvccSnapshot[applied={T|T < 7315574337937727488 or (T in {7315574337937727488})}]
I20260806 15:08:11.104441 5305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.104537 5305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.105352 5305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Sending DeleteTablet for 3 replicas of tablet 3464ac8ab6ea425e8963b9046b9f0187
I20260806 15:08:11.105672 5732 tablet_service.cc:1514] Processing DeleteTablet for tablet 3464ac8ab6ea425e8963b9046b9f0187 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56256
I20260806 15:08:11.105751 5447 tablet_service.cc:1514] Processing DeleteTablet for tablet 3464ac8ab6ea425e8963b9046b9f0187 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:33186
I20260806 15:08:11.105870 5576 tablet_service.cc:1514] Processing DeleteTablet for tablet 3464ac8ab6ea425e8963b9046b9f0187 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:57512
I20260806 15:08:11.105954 5853 tablet_replica.cc:330] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: stopping tablet replica
I20260806 15:08:11.106051 5853 raft_consensus.cc:2229] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:11.106195 5853 raft_consensus.cc:2258] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.106402 5852 tablet_replica.cc:330] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: stopping tablet replica
I20260806 15:08:11.106436 5305 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36838:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 15:08:11.106509 5852 raft_consensus.cc:2229] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260806 15:08:11.106585 5305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:11.106628 5852 raft_consensus.cc:2258] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.107196 5852 ts_tablet_manager.cc:1905] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.108273 5732 tablet_service.cc:1467] Processing CreateTablet for tablet e08bd85c0cb14cc0894036d2199e18fe (DEFAULT_TABLE table=test-table [id=642fabfc88164d44b8a2f6a67586b61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.108285 5447 tablet_service.cc:1467] Processing CreateTablet for tablet e08bd85c0cb14cc0894036d2199e18fe (DEFAULT_TABLE table=test-table [id=642fabfc88164d44b8a2f6a67586b61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.108403 5447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e08bd85c0cb14cc0894036d2199e18fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.108533 5732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e08bd85c0cb14cc0894036d2199e18fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.109378 5852 ts_tablet_manager.cc:1918] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:11.109457 5852 log.cc:1196] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/3464ac8ab6ea425e8963b9046b9f0187
I20260806 15:08:11.109717 5852 ts_tablet_manager.cc:1939] T 3464ac8ab6ea425e8963b9046b9f0187 P 40f46c82fb764ae0b887c4e967210c4a: Deleting consensus metadata
I20260806 15:08:11.109771 5832 tablet_bootstrap.cc:492] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Bootstrap starting.
I20260806 15:08:11.110105 5829 tablet_bootstrap.cc:492] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Bootstrap starting.
I20260806 15:08:11.110186 5832 tablet_bootstrap.cc:654] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.110414 5854 tablet_replica.cc:330] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: stopping tablet replica
I20260806 15:08:11.110376 5290 catalog_manager.cc:4841] TS 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927): tablet 3464ac8ab6ea425e8963b9046b9f0187 (table test-table [id=3127e591339349cf8aad2a7c716f5189]) successfully deleted
I20260806 15:08:11.110574 5854 raft_consensus.cc:2229] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.110725 5829 tablet_bootstrap.cc:654] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.110734 5854 raft_consensus.cc:2258] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.110797 5576 tablet_service.cc:1467] Processing CreateTablet for tablet e08bd85c0cb14cc0894036d2199e18fe (DEFAULT_TABLE table=test-table [id=642fabfc88164d44b8a2f6a67586b61b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.110970 5576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e08bd85c0cb14cc0894036d2199e18fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.111361 5829 tablet_bootstrap.cc:492] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: No bootstrap required, opened a new log
I20260806 15:08:11.111436 5829 ts_tablet_manager.cc:1397] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:11.111593 5829 raft_consensus.cc:348] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.111667 5829 raft_consensus.cc:374] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.111694 5829 raft_consensus.cc:729] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f46c82fb764ae0b887c4e967210c4a, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.111734 5829 consensus_queue.cc:260] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.111824 5829 ts_tablet_manager.cc:1428] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:11.112287 5828 tablet_bootstrap.cc:492] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Bootstrap starting.
I20260806 15:08:11.112658 5854 ts_tablet_manager.cc:1905] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.112661 5853 ts_tablet_manager.cc:1905] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.112702 5828 tablet_bootstrap.cc:654] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.114074 5854 ts_tablet_manager.cc:1918] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:11.114147 5854 log.cc:1196] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/3464ac8ab6ea425e8963b9046b9f0187
I20260806 15:08:11.114387 5853 ts_tablet_manager.cc:1918] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:11.114470 5854 ts_tablet_manager.cc:1939] T 3464ac8ab6ea425e8963b9046b9f0187 P 91d940a8e5be4ebba33701152124aee1: Deleting consensus metadata
I20260806 15:08:11.114500 5853 log.cc:1196] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/3464ac8ab6ea425e8963b9046b9f0187
I20260806 15:08:11.114779 5853 ts_tablet_manager.cc:1939] T 3464ac8ab6ea425e8963b9046b9f0187 P 196087b9e56e48c685fae455c8e355e2: Deleting consensus metadata
I20260806 15:08:11.114809 5832 tablet_bootstrap.cc:492] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: No bootstrap required, opened a new log
I20260806 15:08:11.114856 5832 ts_tablet_manager.cc:1397] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260806 15:08:11.114877 5290 catalog_manager.cc:4841] TS 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531): tablet 3464ac8ab6ea425e8963b9046b9f0187 (table test-table [id=3127e591339349cf8aad2a7c716f5189]) successfully deleted
I20260806 15:08:11.115010 5832 raft_consensus.cc:348] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.115110 5832 raft_consensus.cc:374] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.115135 5832 raft_consensus.cc:729] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.115192 5292 catalog_manager.cc:4841] TS 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465): tablet 3464ac8ab6ea425e8963b9046b9f0187 (table test-table [id=3127e591339349cf8aad2a7c716f5189]) successfully deleted
I20260806 15:08:11.115207 5832 consensus_queue.cc:260] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.115302 5832 ts_tablet_manager.cc:1428] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.115768 5828 tablet_bootstrap.cc:492] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: No bootstrap required, opened a new log
I20260806 15:08:11.115841 5828 ts_tablet_manager.cc:1397] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260806 15:08:11.116008 5828 raft_consensus.cc:348] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.116084 5828 raft_consensus.cc:374] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.116117 5828 raft_consensus.cc:729] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d940a8e5be4ebba33701152124aee1, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.116159 5828 consensus_queue.cc:260] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.116251 5828 ts_tablet_manager.cc:1428] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260806 15:08:11.152930 5801 tablet.cc:2369] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:08:11.399127 5847 raft_consensus.cc:482] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:11.399238 5847 raft_consensus.cc:504] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.399376 5847 leader_election.cc:288] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.399679 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e08bd85c0cb14cc0894036d2199e18fe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1" is_pre_election: true
I20260806 15:08:11.399679 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e08bd85c0cb14cc0894036d2199e18fe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a" is_pre_election: true
I20260806 15:08:11.399798 5754 raft_consensus.cc:2454] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.399798 5610 raft_consensus.cc:2454] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.399987 5396 leader_election.cc:302] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 40f46c82fb764ae0b887c4e967210c4a; no voters:
I20260806 15:08:11.400104 5847 raft_consensus.cc:2781] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:11.400161 5847 raft_consensus.cc:482] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:11.400189 5847 raft_consensus.cc:3037] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.400950 5847 raft_consensus.cc:504] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.401094 5847 leader_election.cc:288] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Requested vote from peers 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.401274 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e08bd85c0cb14cc0894036d2199e18fe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1"
I20260806 15:08:11.401346 5610 raft_consensus.cc:3037] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.401296 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e08bd85c0cb14cc0894036d2199e18fe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a"
I20260806 15:08:11.401381 5754 raft_consensus.cc:3037] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.401963 5610 raft_consensus.cc:2454] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.401980 5754 raft_consensus.cc:2454] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.402161 5396 leader_election.cc:302] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 91d940a8e5be4ebba33701152124aee1; no voters:
I20260806 15:08:11.402271 5847 raft_consensus.cc:2781] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:11.402379 5847 raft_consensus.cc:686] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Becoming Leader. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Running, Role: LEADER
I20260806 15:08:11.402442 5847 consensus_queue.cc:237] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.403012 5305 catalog_manager.cc:5495] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196087b9e56e48c685fae455c8e355e2 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } health_report { overall_health: UNKNOWN } } }
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028890, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.190@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:11.490386 5865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.483079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36854 (local address 127.29.69.190:35899)
0806 15:08:11.483228 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.483230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.483286 (+ 56us) server_negotiation.cc:407] Connection header received
0806 15:08:11.483339 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.483339 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.483350 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.483403 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:11.483846 (+ 443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.484357 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.485034 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.485236 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.485286 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.487485 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:11.487488 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:11.487488 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:11.487499 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:11.489083 (+ 1584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:11.489489 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:11.489490 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:11.489491 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:11.489552 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:11.489746 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:11.489747 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:11.489747 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:11.489879 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:11.489952 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.490114 (+ 162us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.490223 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":67,"threads_started":1}
I20260806 15:08:11.490406 5864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.483019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35899 (local address 127.0.0.1:36854)
0806 15:08:11.483211 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.483221 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.483284 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.483422 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.483423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.483727 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:11.483776 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.483778 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.484422 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.484423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.484962 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.484963 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.485301 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.485301 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.485354 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.485846 (+ 492us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:11.485850 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:11.487380 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:11.489178 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:11.489186 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:11.489188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:11.489400 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:11.489619 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:11.489620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:11.489620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:11.489683 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:11.489956 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:11.489963 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:11.490006 (+ 43us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.490090 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.490283 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":87,"thread_start_us":92,"threads_started":1}
I20260806 15:08:11.492226 5305 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:36854:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260806 15:08:11.492412 5305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:11.493884 5732 tablet_service.cc:1467] Processing CreateTablet for tablet a8dd70c675084a7fab3e3b1a0e6ecffe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59f0665e994e4177ae6cd2bb60459667]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:08:11.493867 5576 tablet_service.cc:1467] Processing CreateTablet for tablet a8dd70c675084a7fab3e3b1a0e6ecffe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59f0665e994e4177ae6cd2bb60459667]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:08:11.494038 5732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8dd70c675084a7fab3e3b1a0e6ecffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.494038 5576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8dd70c675084a7fab3e3b1a0e6ecffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.494453 5447 tablet_service.cc:1467] Processing CreateTablet for tablet a8dd70c675084a7fab3e3b1a0e6ecffe (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=59f0665e994e4177ae6cd2bb60459667]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260806 15:08:11.494617 5447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8dd70c675084a7fab3e3b1a0e6ecffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.495605 5829 tablet_bootstrap.cc:492] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: Bootstrap starting.
I20260806 15:08:11.496037 5829 tablet_bootstrap.cc:654] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.496114 5832 tablet_bootstrap.cc:492] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: Bootstrap starting.
I20260806 15:08:11.496336 5828 tablet_bootstrap.cc:492] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: Bootstrap starting.
I20260806 15:08:11.496416 5832 tablet_bootstrap.cc:654] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.496685 5829 tablet_bootstrap.cc:492] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: No bootstrap required, opened a new log
I20260806 15:08:11.496735 5828 tablet_bootstrap.cc:654] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.496731 5829 ts_tablet_manager.cc:1397] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:11.496905 5829 raft_consensus.cc:348] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.496974 5832 tablet_bootstrap.cc:492] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: No bootstrap required, opened a new log
I20260806 15:08:11.496978 5829 raft_consensus.cc:374] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.497008 5832 ts_tablet_manager.cc:1397] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:11.497007 5829 raft_consensus.cc:729] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f46c82fb764ae0b887c4e967210c4a, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.497062 5829 consensus_queue.cc:260] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.497135 5832 raft_consensus.cc:348] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.497195 5829 ts_tablet_manager.cc:1428] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:11.497225 5832 raft_consensus.cc:374] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.497254 5832 raft_consensus.cc:729] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.497308 5832 consensus_queue.cc:260] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.497334 5835 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.497407 5832 ts_tablet_manager.cc:1428] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.497413 5835 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.497422 5847 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.497498 5828 tablet_bootstrap.cc:492] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: No bootstrap required, opened a new log
I20260806 15:08:11.497495 5847 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.497545 5828 ts_tablet_manager.cc:1397] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:11.497692 5828 raft_consensus.cc:348] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.497754 5828 raft_consensus.cc:374] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.497773 5828 raft_consensus.cc:729] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d940a8e5be4ebba33701152124aee1, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.497818 5828 consensus_queue.cc:260] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.497925 5828 ts_tablet_manager.cc:1428] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.497998 5834 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.498131 5834 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.510609 5847 raft_consensus.cc:482] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:11.510695 5847 raft_consensus.cc:504] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.510825 5847 leader_election.cc:288] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.510980 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8dd70c675084a7fab3e3b1a0e6ecffe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1" is_pre_election: true
I20260806 15:08:11.511072 5610 raft_consensus.cc:2454] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.511019 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8dd70c675084a7fab3e3b1a0e6ecffe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a" is_pre_election: true
I20260806 15:08:11.511139 5754 raft_consensus.cc:2454] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.511250 5396 leader_election.cc:302] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 91d940a8e5be4ebba33701152124aee1; no voters:
I20260806 15:08:11.511363 5847 raft_consensus.cc:2781] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:11.511404 5847 raft_consensus.cc:482] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:11.511436 5847 raft_consensus.cc:3037] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.512009 5847 raft_consensus.cc:504] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.512140 5847 leader_election.cc:288] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Requested vote from peers 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.512281 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8dd70c675084a7fab3e3b1a0e6ecffe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1"
I20260806 15:08:11.512316 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8dd70c675084a7fab3e3b1a0e6ecffe" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a"
I20260806 15:08:11.512358 5610 raft_consensus.cc:3037] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.512383 5754 raft_consensus.cc:3037] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.513073 5754 raft_consensus.cc:2454] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.513088 5610 raft_consensus.cc:2454] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.513278 5396 leader_election.cc:302] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 40f46c82fb764ae0b887c4e967210c4a; no voters:
I20260806 15:08:11.513388 5847 raft_consensus.cc:2781] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:11.513463 5847 raft_consensus.cc:686] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Becoming Leader. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Running, Role: LEADER
I20260806 15:08:11.513518 5847 consensus_queue.cc:237] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.513852 5839 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: TxnStatusTablet state changed. Reason: New leader 196087b9e56e48c685fae455c8e355e2. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.513950 5839 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:08:11.514176 5870 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260806 15:08:11.514147 5306 catalog_manager.cc:5495] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196087b9e56e48c685fae455c8e355e2 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } health_report { overall_health: UNKNOWN } } }
I20260806 15:08:11.514279 5870 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260806 15:08:11.520212 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.517827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33202 (local address 127.29.69.129:34465)
0806 15:08:11.517876 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.517879 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.517886 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:11.517966 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.517967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.517979 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.518030 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:11.518177 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.518727 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.519492 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.519698 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.519770 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.519943 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.519980 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.520049 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.520124 (+ 75us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.520149 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:08:11.520252 5864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.517724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:34465 (local address 127.0.0.1:33202)
0806 15:08:11.517823 (+ 99us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.517836 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.517891 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.518037 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.518038 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.518039 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:08:11.518095 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.518097 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.518810 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.518811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.519393 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.519395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.519781 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.519782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.519850 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.519864 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.520067 (+ 203us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.520076 (+ 9us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.520122 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.520175 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 15:08:11.521162 5754 raft_consensus.cc:1261] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.521237 5610 raft_consensus.cc:1261] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.521418 5839 consensus_queue.cc:1035] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.521538 5847 consensus_queue.cc:1035] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.521898 5835 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: TxnStatusTablet state changed. Reason: New leader 196087b9e56e48c685fae455c8e355e2. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.521983 5835 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.521950 5834 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: TxnStatusTablet state changed. Reason: New leader 196087b9e56e48c685fae455c8e355e2. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.522017 5834 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.522749 5836 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.522830 5836 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:08:11.523420 5839 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.523497 5839 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 196087b9e56e48c685fae455c8e355e2: This TxnStatusTablet replica's current role is: LEADER
I20260806 15:08:11.523834 5834 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.523916 5834 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 91d940a8e5be4ebba33701152124aee1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.524219 5835 tablet_replica.cc:439] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } } }
I20260806 15:08:11.524326 5835 tablet_replica.cc:442] T a8dd70c675084a7fab3e3b1a0e6ecffe P 40f46c82fb764ae0b887c4e967210c4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260806 15:08:11.529764 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.527243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:40181 (local address 127.29.69.129:34465)
0806 15:08:11.527279 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.527281 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.527408 (+ 127us) server_negotiation.cc:407] Connection header received
0806 15:08:11.527464 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.527465 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.527472 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.527517 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:11.527628 (+ 111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.528047 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.529108 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.529291 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.529343 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.529522 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.529545 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.529595 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.529665 (+ 70us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.529697 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":18}
I20260806 15:08:11.529838 5878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.527182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:34465 (local address 127.29.69.129:40181)
0806 15:08:11.527341 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.527351 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.527406 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.527521 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.527522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.527523 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0806 15:08:11.527571 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.527572 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.528117 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.528118 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.529021 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.529024 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.529364 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.529365 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.529428 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.529444 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.529609 (+ 165us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.529610 (+ 1us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.529661 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.529718 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"mutex_wait_us":1,"thread_start_us":74,"threads_started":1}
I20260806 15:08:11.531745 5610 raft_consensus.cc:1261] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.531735 5754 raft_consensus.cc:1261] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.531925 5839 consensus_queue.cc:1035] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.532002 5836 consensus_queue.cc:1035] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.542254 5306 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.542389 5306 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:36838:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.543033 5306 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Sending DeleteTablet for 3 replicas of tablet e08bd85c0cb14cc0894036d2199e18fe
I20260806 15:08:11.543269 5446 tablet_service.cc:1514] Processing DeleteTablet for tablet e08bd85c0cb14cc0894036d2199e18fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:33186
I20260806 15:08:11.543357 5853 tablet_replica.cc:330] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: stopping tablet replica
I20260806 15:08:11.543402 5853 raft_consensus.cc:2229] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:11.543380 5576 tablet_service.cc:1514] Processing DeleteTablet for tablet e08bd85c0cb14cc0894036d2199e18fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:57512
I20260806 15:08:11.543452 5853 raft_consensus.cc:2258] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.543514 5854 tablet_replica.cc:330] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: stopping tablet replica
I20260806 15:08:11.543562 5854 raft_consensus.cc:2229] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.543594 5854 raft_consensus.cc:2258] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.543820 5853 ts_tablet_manager.cc:1905] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.544445 5732 tablet_service.cc:1514] Processing DeleteTablet for tablet e08bd85c0cb14cc0894036d2199e18fe with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56256
I20260806 15:08:11.544531 5852 tablet_replica.cc:330] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: stopping tablet replica
I20260806 15:08:11.544579 5852 raft_consensus.cc:2229] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.544661 5852 raft_consensus.cc:2258] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.544996 5852 ts_tablet_manager.cc:1905] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.545564 5853 ts_tablet_manager.cc:1918] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:08:11.545627 5853 log.cc:1196] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/e08bd85c0cb14cc0894036d2199e18fe
I20260806 15:08:11.545853 5853 ts_tablet_manager.cc:1939] T e08bd85c0cb14cc0894036d2199e18fe P 196087b9e56e48c685fae455c8e355e2: Deleting consensus metadata
I20260806 15:08:11.546650 5852 ts_tablet_manager.cc:1918] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:08:11.546726 5852 log.cc:1196] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/e08bd85c0cb14cc0894036d2199e18fe
I20260806 15:08:11.546927 5852 ts_tablet_manager.cc:1939] T e08bd85c0cb14cc0894036d2199e18fe P 40f46c82fb764ae0b887c4e967210c4a: Deleting consensus metadata
I20260806 15:08:11.547219 5854 ts_tablet_manager.cc:1905] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.547506 5290 catalog_manager.cc:4841] TS 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927): tablet e08bd85c0cb14cc0894036d2199e18fe (table test-table [id=642fabfc88164d44b8a2f6a67586b61b]) successfully deleted
I20260806 15:08:11.547854 5292 catalog_manager.cc:4841] TS 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465): tablet e08bd85c0cb14cc0894036d2199e18fe (table test-table [id=642fabfc88164d44b8a2f6a67586b61b]) successfully deleted
I20260806 15:08:11.548698 5854 ts_tablet_manager.cc:1918] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:08:11.548780 5854 log.cc:1196] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/e08bd85c0cb14cc0894036d2199e18fe
I20260806 15:08:11.549013 5854 ts_tablet_manager.cc:1939] T e08bd85c0cb14cc0894036d2199e18fe P 91d940a8e5be4ebba33701152124aee1: Deleting consensus metadata
I20260806 15:08:11.549316 5290 catalog_manager.cc:4841] TS 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531): tablet e08bd85c0cb14cc0894036d2199e18fe (table test-table [id=642fabfc88164d44b8a2f6a67586b61b]) successfully deleted
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5260](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 15:08:11.572052 5865 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:11.565280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36862 (local address 127.29.69.190:35899)
0806 15:08:11.565358 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.565360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.565458 (+ 98us) server_negotiation.cc:407] Connection header received
0806 15:08:11.565514 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.565515 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.565528 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.565586 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:11.566289 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.567117 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.568224 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.568567 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.568634 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.571979 (+ 3345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36862: BlockingRecv error: recv got EOF from 127.0.0.1:36862 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5260](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028891, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM
I20260806 15:08:11.580085 5865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.572868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36870 (local address 127.29.69.190:35899)
0806 15:08:11.572903 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.572905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.573015 (+ 110us) server_negotiation.cc:407] Connection header received
0806 15:08:11.573040 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.573041 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.573050 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.573118 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:11.573513 (+ 395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.574262 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.574950 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.575252 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.575321 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.577440 (+ 2119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:11.577441 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:11.577441 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:11.577449 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:11.578980 (+ 1531us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:11.579302 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:11.579303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:11.579304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:11.579364 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:11.579536 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:11.579536 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:11.579537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:11.579662 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:11.579762 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.579907 (+ 145us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.579984 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:08:11.581578 5306 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36870:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:08:11.581754 5306 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:11.583142 5446 tablet_service.cc:1467] Processing CreateTablet for tablet e61166b153ab4f7e82b9df653b0fd6d1 (DEFAULT_TABLE table=test-table [id=434d2488f79c4f7d8d6878e4f051ec92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.583182 5576 tablet_service.cc:1467] Processing CreateTablet for tablet e61166b153ab4f7e82b9df653b0fd6d1 (DEFAULT_TABLE table=test-table [id=434d2488f79c4f7d8d6878e4f051ec92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.583285 5446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e61166b153ab4f7e82b9df653b0fd6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.583335 5576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e61166b153ab4f7e82b9df653b0fd6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.584286 5828 tablet_bootstrap.cc:492] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Bootstrap starting.
I20260806 15:08:11.584728 5828 tablet_bootstrap.cc:654] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.584791 5832 tablet_bootstrap.cc:492] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Bootstrap starting.
I20260806 15:08:11.585088 5832 tablet_bootstrap.cc:654] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.585390 5828 tablet_bootstrap.cc:492] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: No bootstrap required, opened a new log
I20260806 15:08:11.585413 5732 tablet_service.cc:1467] Processing CreateTablet for tablet e61166b153ab4f7e82b9df653b0fd6d1 (DEFAULT_TABLE table=test-table [id=434d2488f79c4f7d8d6878e4f051ec92]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.585443 5828 ts_tablet_manager.cc:1397] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:11.585530 5732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e61166b153ab4f7e82b9df653b0fd6d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.585616 5828 raft_consensus.cc:348] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.585675 5828 raft_consensus.cc:374] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.585687 5828 raft_consensus.cc:729] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d940a8e5be4ebba33701152124aee1, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.585742 5828 consensus_queue.cc:260] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.585834 5828 ts_tablet_manager.cc:1428] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.586606 5832 tablet_bootstrap.cc:492] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: No bootstrap required, opened a new log
I20260806 15:08:11.586665 5832 ts_tablet_manager.cc:1397] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:08:11.586773 5832 raft_consensus.cc:348] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.586833 5829 tablet_bootstrap.cc:492] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Bootstrap starting.
I20260806 15:08:11.586860 5832 raft_consensus.cc:374] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.586890 5832 raft_consensus.cc:729] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.586932 5832 consensus_queue.cc:260] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.587028 5832 ts_tablet_manager.cc:1428] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.587229 5829 tablet_bootstrap.cc:654] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.588028 5829 tablet_bootstrap.cc:492] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: No bootstrap required, opened a new log
I20260806 15:08:11.588083 5829 ts_tablet_manager.cc:1397] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:11.588225 5829 raft_consensus.cc:348] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.588291 5829 raft_consensus.cc:374] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.588311 5829 raft_consensus.cc:729] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f46c82fb764ae0b887c4e967210c4a, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.588361 5829 consensus_queue.cc:260] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.588449 5829 ts_tablet_manager.cc:1428] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.607026 5834 raft_consensus.cc:482] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:11.607128 5834 raft_consensus.cc:504] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.607506 5834 leader_election.cc:288] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.611238 5899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.607668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:43927 (local address 127.29.69.130:41291)
0806 15:08:11.607840 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.607850 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.607889 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.608155 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.608156 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.608159 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:11.608238 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.608240 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.609293 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.609294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.610375 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.610378 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.610945 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.610946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.611035 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.611038 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.611104 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.611148 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":19,"thread_start_us":45,"threads_started":1}
I20260806 15:08:11.611234 5900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.607782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:41291 (local address 127.29.69.131:43927)
0806 15:08:11.607994 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.607995 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.608002 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:11.608022 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.608022 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.608030 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.608137 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:11.608331 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.609187 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.610452 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.610850 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.610936 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.610944 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.611111 (+ 167us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.611157 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":74,"threads_started":1}
I20260806 15:08:11.611294 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.607902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:44553 (local address 127.29.69.129:34465)
0806 15:08:11.607947 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.607949 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.607958 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:08:11.607985 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.607986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.607995 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.608078 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:11.608280 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.608772 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.610272 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.610843 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.610923 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.610935 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.611183 (+ 248us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.611227 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:08:11.611555 5898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.607668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:34465 (local address 127.29.69.130:44553)
0806 15:08:11.607788 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.607800 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:11.607856 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:11.608103 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:11.608104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:11.608107 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:11.608202 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.608204 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.608859 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.608860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.610162 (+ 1302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:11.610165 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.611009 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.611010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:11.611085 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.611090 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:08:11.611426 (+ 336us) client_negotiation.cc:240] Negotiation successful
0806 15:08:11.611475 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":58,"threads_started":1}
I20260806 15:08:11.611855 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e61166b153ab4f7e82b9df653b0fd6d1" candidate_uuid: "91d940a8e5be4ebba33701152124aee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a" is_pre_election: true
I20260806 15:08:11.611862 5459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e61166b153ab4f7e82b9df653b0fd6d1" candidate_uuid: "91d940a8e5be4ebba33701152124aee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196087b9e56e48c685fae455c8e355e2" is_pre_election: true
I20260806 15:08:11.611971 5754 raft_consensus.cc:2454] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d940a8e5be4ebba33701152124aee1 in term 0.
I20260806 15:08:11.611990 5459 raft_consensus.cc:2454] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91d940a8e5be4ebba33701152124aee1 in term 0.
I20260806 15:08:11.612460 5539 leader_election.cc:302] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40f46c82fb764ae0b887c4e967210c4a, 91d940a8e5be4ebba33701152124aee1; no voters:
I20260806 15:08:11.612618 5834 raft_consensus.cc:2781] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:11.612677 5834 raft_consensus.cc:482] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:11.612700 5834 raft_consensus.cc:3037] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.613610 5834 raft_consensus.cc:504] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.613746 5834 leader_election.cc:288] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [CANDIDATE]: Term 1 election: Requested vote from peers 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.613935 5459 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e61166b153ab4f7e82b9df653b0fd6d1" candidate_uuid: "91d940a8e5be4ebba33701152124aee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "196087b9e56e48c685fae455c8e355e2"
I20260806 15:08:11.614022 5459 raft_consensus.cc:3037] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.613953 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e61166b153ab4f7e82b9df653b0fd6d1" candidate_uuid: "91d940a8e5be4ebba33701152124aee1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a"
I20260806 15:08:11.614065 5754 raft_consensus.cc:3037] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.614787 5754 raft_consensus.cc:2454] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d940a8e5be4ebba33701152124aee1 in term 1.
I20260806 15:08:11.614874 5459 raft_consensus.cc:2454] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91d940a8e5be4ebba33701152124aee1 in term 1.
I20260806 15:08:11.615041 5541 leader_election.cc:302] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 91d940a8e5be4ebba33701152124aee1; no voters:
I20260806 15:08:11.615206 5834 raft_consensus.cc:2781] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:11.615339 5834 raft_consensus.cc:686] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 1 LEADER]: Becoming Leader. State: Replica: 91d940a8e5be4ebba33701152124aee1, State: Running, Role: LEADER
I20260806 15:08:11.615401 5834 consensus_queue.cc:237] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.616087 5305 catalog_manager.cc:5495] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91d940a8e5be4ebba33701152124aee1 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "91d940a8e5be4ebba33701152124aee1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } health_report { overall_health: UNKNOWN } } }
I20260806 15:08:11.627456 5904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.624860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57516 (local address 127.29.69.130:40531)
0806 15:08:11.625022 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.625024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.625029 (+ 5us) server_negotiation.cc:407] Connection header received
0806 15:08:11.625064 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.625064 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.625079 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.625165 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:11.625312 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.625795 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.626613 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.626831 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.626905 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.627085 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.627217 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.627310 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.627332 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.627354 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":90,"threads_started":1}
I20260806 15:08:11.628598 5754 raft_consensus.cc:1261] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Refusing update from remote peer 91d940a8e5be4ebba33701152124aee1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.628888 5459 raft_consensus.cc:1261] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Refusing update from remote peer 91d940a8e5be4ebba33701152124aee1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.629199 5901 consensus_queue.cc:1035] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.629372 5834 consensus_queue.cc:1035] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.633848 5305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.633942 5305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.634653 5305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Sending DeleteTablet for 3 replicas of tablet e61166b153ab4f7e82b9df653b0fd6d1
I20260806 15:08:11.634899 5576 tablet_service.cc:1514] Processing DeleteTablet for tablet e61166b153ab4f7e82b9df653b0fd6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:57512
I20260806 15:08:11.634991 5732 tablet_service.cc:1514] Processing DeleteTablet for tablet e61166b153ab4f7e82b9df653b0fd6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56256
I20260806 15:08:11.635080 5854 tablet_replica.cc:330] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: stopping tablet replica
I20260806 15:08:11.635130 5854 raft_consensus.cc:2229] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:11.635097 5305 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36870:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260806 15:08:11.635203 5854 raft_consensus.cc:2258] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 15:08:11.635223 5305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:11.635263 5852 tablet_replica.cc:330] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: stopping tablet replica
I20260806 15:08:11.635313 5852 raft_consensus.cc:2229] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.635360 5852 raft_consensus.cc:2258] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.636034 5854 ts_tablet_manager.cc:1905] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.637661 5446 tablet_service.cc:1514] Processing DeleteTablet for tablet e61166b153ab4f7e82b9df653b0fd6d1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:33186
I20260806 15:08:11.637677 5854 ts_tablet_manager.cc:1918] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:11.637732 5854 log.cc:1196] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/e61166b153ab4f7e82b9df653b0fd6d1
I20260806 15:08:11.637795 5853 tablet_replica.cc:330] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: stopping tablet replica
I20260806 15:08:11.637850 5853 raft_consensus.cc:2229] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.637900 5853 raft_consensus.cc:2258] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.637982 5854 ts_tablet_manager.cc:1939] T e61166b153ab4f7e82b9df653b0fd6d1 P 91d940a8e5be4ebba33701152124aee1: Deleting consensus metadata
I20260806 15:08:11.638293 5290 catalog_manager.cc:4841] TS 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531): tablet e61166b153ab4f7e82b9df653b0fd6d1 (table test-table [id=434d2488f79c4f7d8d6878e4f051ec92]) successfully deleted
I20260806 15:08:11.638329 5852 ts_tablet_manager.cc:1905] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.639753 5852 ts_tablet_manager.cc:1918] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:11.639803 5852 log.cc:1196] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/e61166b153ab4f7e82b9df653b0fd6d1
I20260806 15:08:11.640007 5852 ts_tablet_manager.cc:1939] T e61166b153ab4f7e82b9df653b0fd6d1 P 40f46c82fb764ae0b887c4e967210c4a: Deleting consensus metadata
I20260806 15:08:11.640369 5290 catalog_manager.cc:4841] TS 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927): tablet e61166b153ab4f7e82b9df653b0fd6d1 (table test-table [id=434d2488f79c4f7d8d6878e4f051ec92]) successfully deleted
I20260806 15:08:11.641546 5576 tablet_service.cc:1467] Processing CreateTablet for tablet 60e20d2d4bc14a67a09bbe81000e10f0 (DEFAULT_TABLE table=test-table [id=4fd8951c674e43d3adf703e61ca92f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.641672 5576 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60e20d2d4bc14a67a09bbe81000e10f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.642948 5828 tablet_bootstrap.cc:492] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Bootstrap starting.
I20260806 15:08:11.643095 5732 tablet_service.cc:1467] Processing CreateTablet for tablet 60e20d2d4bc14a67a09bbe81000e10f0 (DEFAULT_TABLE table=test-table [id=4fd8951c674e43d3adf703e61ca92f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.643196 5732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60e20d2d4bc14a67a09bbe81000e10f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.643359 5828 tablet_bootstrap.cc:654] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.644392 5829 tablet_bootstrap.cc:492] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Bootstrap starting.
I20260806 15:08:11.644562 5853 ts_tablet_manager.cc:1905] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.645010 5829 tablet_bootstrap.cc:654] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.646097 5853 ts_tablet_manager.cc:1918] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:11.646163 5853 log.cc:1196] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/e61166b153ab4f7e82b9df653b0fd6d1
I20260806 15:08:11.646399 5853 ts_tablet_manager.cc:1939] T e61166b153ab4f7e82b9df653b0fd6d1 P 196087b9e56e48c685fae455c8e355e2: Deleting consensus metadata
I20260806 15:08:11.646739 5292 catalog_manager.cc:4841] TS 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465): tablet e61166b153ab4f7e82b9df653b0fd6d1 (table test-table [id=434d2488f79c4f7d8d6878e4f051ec92]) successfully deleted
I20260806 15:08:11.646888 5446 tablet_service.cc:1467] Processing CreateTablet for tablet 60e20d2d4bc14a67a09bbe81000e10f0 (DEFAULT_TABLE table=test-table [id=4fd8951c674e43d3adf703e61ca92f1b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:11.646981 5446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60e20d2d4bc14a67a09bbe81000e10f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:11.647214 5829 tablet_bootstrap.cc:492] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: No bootstrap required, opened a new log
I20260806 15:08:11.647261 5829 ts_tablet_manager.cc:1397] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 15:08:11.647400 5829 raft_consensus.cc:348] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.647462 5829 raft_consensus.cc:374] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.647482 5829 raft_consensus.cc:729] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40f46c82fb764ae0b887c4e967210c4a, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.647523 5829 consensus_queue.cc:260] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.647615 5829 ts_tablet_manager.cc:1428] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.648288 5832 tablet_bootstrap.cc:492] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: Bootstrap starting.
I20260806 15:08:11.648694 5832 tablet_bootstrap.cc:654] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:11.649365 5832 tablet_bootstrap.cc:492] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: No bootstrap required, opened a new log
I20260806 15:08:11.649418 5832 ts_tablet_manager.cc:1397] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:11.649559 5832 raft_consensus.cc:348] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.649631 5832 raft_consensus.cc:374] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.649652 5832 raft_consensus.cc:729] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.649694 5832 consensus_queue.cc:260] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.649780 5832 ts_tablet_manager.cc:1428] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:11.650769 5828 tablet_bootstrap.cc:492] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: No bootstrap required, opened a new log
I20260806 15:08:11.650818 5828 ts_tablet_manager.cc:1397] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.000s
I20260806 15:08:11.650951 5828 raft_consensus.cc:348] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.651011 5828 raft_consensus.cc:374] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:11.651032 5828 raft_consensus.cc:729] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91d940a8e5be4ebba33701152124aee1, State: Initialized, Role: FOLLOWER
I20260806 15:08:11.651078 5828 consensus_queue.cc:260] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.651160 5828 ts_tablet_manager.cc:1428] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:11.788741 5836 raft_consensus.cc:482] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:11.788852 5836 raft_consensus.cc:504] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.789019 5836 leader_election.cc:288] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.789261 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e20d2d4bc14a67a09bbe81000e10f0" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a" is_pre_election: true
I20260806 15:08:11.789263 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e20d2d4bc14a67a09bbe81000e10f0" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1" is_pre_election: true
I20260806 15:08:11.789359 5610 raft_consensus.cc:2454] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.789372 5754 raft_consensus.cc:2454] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 0.
I20260806 15:08:11.789557 5396 leader_election.cc:302] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 91d940a8e5be4ebba33701152124aee1; no voters:
I20260806 15:08:11.789714 5836 raft_consensus.cc:2781] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:11.789779 5836 raft_consensus.cc:482] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:11.789811 5836 raft_consensus.cc:3037] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.790598 5836 raft_consensus.cc:504] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.790747 5836 leader_election.cc:288] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Requested vote from peers 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531), 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927)
I20260806 15:08:11.790953 5610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e20d2d4bc14a67a09bbe81000e10f0" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91d940a8e5be4ebba33701152124aee1"
I20260806 15:08:11.791030 5610 raft_consensus.cc:3037] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.791006 5754 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60e20d2d4bc14a67a09bbe81000e10f0" candidate_uuid: "196087b9e56e48c685fae455c8e355e2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40f46c82fb764ae0b887c4e967210c4a"
I20260806 15:08:11.791119 5754 raft_consensus.cc:3037] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:11.791754 5754 raft_consensus.cc:2454] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.791870 5610 raft_consensus.cc:2454] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 196087b9e56e48c685fae455c8e355e2 in term 1.
I20260806 15:08:11.791980 5396 leader_election.cc:302] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 196087b9e56e48c685fae455c8e355e2, 40f46c82fb764ae0b887c4e967210c4a; no voters:
I20260806 15:08:11.792114 5836 raft_consensus.cc:2781] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:11.792197 5836 raft_consensus.cc:686] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Becoming Leader. State: Replica: 196087b9e56e48c685fae455c8e355e2, State: Running, Role: LEADER
I20260806 15:08:11.792284 5836 consensus_queue.cc:237] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } }
I20260806 15:08:11.792886 5306 catalog_manager.cc:5495] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 196087b9e56e48c685fae455c8e355e2 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "196087b9e56e48c685fae455c8e355e2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "196087b9e56e48c685fae455c8e355e2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 34465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 } health_report { overall_health: UNKNOWN } } }
I20260806 15:08:11.829813 5824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.827842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33214 (local address 127.29.69.129:34465)
0806 15:08:11.827889 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:11.827891 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:11.827899 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:11.827928 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:11.827929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:11.827938 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:11.827987 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:11.828100 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.828588 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.829261 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:11.829440 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:11.829489 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:11.829616 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:11.829646 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:11.829684 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:11.829737 (+ 53us) server_negotiation.cc:299] Negotiation successful
0806 15:08:11.829752 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:08:11.831964 5610 raft_consensus.cc:1261] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.832017 5754 raft_consensus.cc:1261] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Refusing update from remote peer 196087b9e56e48c685fae455c8e355e2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:11.832206 5847 consensus_queue.cc:1035] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40f46c82fb764ae0b887c4e967210c4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.832379 5836 consensus_queue.cc:1035] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91d940a8e5be4ebba33701152124aee1" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:11.842435 5306 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.842525 5306 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:36870:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:11.843158 5306 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c83a26091d6e4157b8128d6940fa46eb: Sending DeleteTablet for 3 replicas of tablet 60e20d2d4bc14a67a09bbe81000e10f0
I20260806 15:08:11.843477 5732 tablet_service.cc:1514] Processing DeleteTablet for tablet 60e20d2d4bc14a67a09bbe81000e10f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56256
I20260806 15:08:11.843479 5576 tablet_service.cc:1514] Processing DeleteTablet for tablet 60e20d2d4bc14a67a09bbe81000e10f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:57512
I20260806 15:08:11.843571 5446 tablet_service.cc:1514] Processing DeleteTablet for tablet 60e20d2d4bc14a67a09bbe81000e10f0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:11 UTC) from {username='oryx', principal='oryx/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:33186
I20260806 15:08:11.843595 5852 tablet_replica.cc:330] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: stopping tablet replica
I20260806 15:08:11.843667 5852 raft_consensus.cc:2229] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.843679 5853 tablet_replica.cc:330] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: stopping tablet replica
I20260806 15:08:11.843678 5854 tablet_replica.cc:330] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: stopping tablet replica
I20260806 15:08:11.843701 5852 raft_consensus.cc:2258] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.843731 5854 raft_consensus.cc:2229] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:11.843730 5853 raft_consensus.cc:2229] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:11.843771 5854 raft_consensus.cc:2258] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.843801 5853 raft_consensus.cc:2258] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:11.844036 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 5380
I20260806 15:08:11.844218 5853 ts_tablet_manager.cc:1905] T 60e20d2d4bc14a67a09bbe81000e10f0 P 196087b9e56e48c685fae455c8e355e2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.845584 5852 ts_tablet_manager.cc:1905] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.845729 5854 ts_tablet_manager.cc:1905] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:11.847184 5852 ts_tablet_manager.cc:1918] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:08:11.847241 5852 log.cc:1196] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/60e20d2d4bc14a67a09bbe81000e10f0
I20260806 15:08:11.847262 5854 ts_tablet_manager.cc:1918] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260806 15:08:11.847311 5854 log.cc:1196] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/60e20d2d4bc14a67a09bbe81000e10f0
I20260806 15:08:11.847479 5852 ts_tablet_manager.cc:1939] T 60e20d2d4bc14a67a09bbe81000e10f0 P 40f46c82fb764ae0b887c4e967210c4a: Deleting consensus metadata
I20260806 15:08:11.847527 5854 ts_tablet_manager.cc:1939] T 60e20d2d4bc14a67a09bbe81000e10f0 P 91d940a8e5be4ebba33701152124aee1: Deleting consensus metadata
I20260806 15:08:11.847810 5290 catalog_manager.cc:4841] TS 40f46c82fb764ae0b887c4e967210c4a (127.29.69.131:43927): tablet 60e20d2d4bc14a67a09bbe81000e10f0 (table test-table [id=4fd8951c674e43d3adf703e61ca92f1b]) successfully deleted
I20260806 15:08:11.847903 5290 catalog_manager.cc:4841] TS 91d940a8e5be4ebba33701152124aee1 (127.29.69.130:40531): tablet 60e20d2d4bc14a67a09bbe81000e10f0 (table test-table [id=4fd8951c674e43d3adf703e61ca92f1b]) successfully deleted
W20260806 15:08:11.852320 5292 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:34465 (error 108)
I20260806 15:08:11.852531 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 5523
I20260806 15:08:11.853621 5916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:11.853354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:34465 (local address 127.0.0.1:33228)
0806 15:08:11.853534 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:11.853577 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:34465: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":120,"threads_started":1}
W20260806 15:08:11.853709 5292 catalog_manager.cc:4584] TS 196087b9e56e48c685fae455c8e355e2 (127.29.69.129:34465): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 60e20d2d4bc14a67a09bbe81000e10f0: Network error: Client connection negotiation failed: client connection to 127.29.69.129:34465: connect: Connection refused (error 111)
I20260806 15:08:11.859632 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 5666
I20260806 15:08:11.865080 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 5273
2026-08-06T15:08:11Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2786 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5919](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5919](info): set up 2 sockets
Aug 06 15:08:11 dist-test-slave-tm1g krb5kdc[5919](info): commencing operation
krb5kdc: starting...
W20260806 15:08:12.907662 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:12 dist-test-slave-tm1g krb5kdc[5919](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028892, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:08:13.020666 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40501
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:44745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:40501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:13.101400 5933 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:13.101650 5933 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:13.101691 5933 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:13.102865 5933 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:13.102933 5933 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:13.102957 5933 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:13.102977 5933 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:13.103008 5933 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:13.104487 5933 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:40501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5933
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:13.104763 5933 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:13.104990 5933 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:13.109791 5938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:13.109791 5939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:13.109768 5941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:13.110081 5933 server_base.cc:1034] running on GCE node
I20260806 15:08:13.110383 5933 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:13.110677 5933 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:13.111840 5933 hybrid_clock.cc:648] HybridClock initialized: now 1786028893111832 us; error 40 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-06T15:08:13Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1251 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:13 dist-test-slave-tm1g krb5kdc[5946](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:13 dist-test-slave-tm1g krb5kdc[5946](info): set up 2 sockets
Aug 06 15:08:13 dist-test-slave-tm1g krb5kdc[5946](info): commencing operation
krb5kdc: starting...
W20260806 15:08:14.175683 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:08:14.289135 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42785
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:42785
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:14.368449 5960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:14.368646 5960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:14.368669 5960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:14.369729 5960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:14.369761 5960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:14.369776 5960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:14.369788 5960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:14.369800 5960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:14.371268 5960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:42785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:14.371450 5960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:14.371614 5960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:08:14.376405 5960 server_base.cc:1034] running on GCE node
W20260806 15:08:14.376385 5966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.376362 5965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.376411 5968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:14.376801 5960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:14.377086 5960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:14.378225 5960 hybrid_clock.cc:648] HybridClock initialized: now 1786028894378217 us; error 29 us; skew 500 ppm
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:14.385090 5960 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:08:14.385546 5960 webserver.cc:460] Webserver started at http://127.29.69.190:44941/ using document root <none> and password file <none>
I20260806 15:08:14.385727 5960 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:14.385767 5960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:14.385856 5960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:14.386904 5960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "c3e0881817d944beb0a2364c488e8a96"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "58d0cc7f9669f71fdfd2517f3aae407f"
server_key_iv: "b0f460b24b7933cf2d64520c0bb8f240"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.387214 5960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "c3e0881817d944beb0a2364c488e8a96"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "58d0cc7f9669f71fdfd2517f3aae407f"
server_key_iv: "b0f460b24b7933cf2d64520c0bb8f240"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.388499 5960 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:14.389185 5975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.389374 5960 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:14.389482 5960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "c3e0881817d944beb0a2364c488e8a96"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "58d0cc7f9669f71fdfd2517f3aae407f"
server_key_iv: "b0f460b24b7933cf2d64520c0bb8f240"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.389567 5960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:14.406188 5960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:14.408512 5960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:14.408684 5960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:14.412748 5960 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:42785
I20260806 15:08:14.412788 6029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:42785 every 8 connection(s)
I20260806 15:08:14.413138 5960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:14.413403 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 5960
I20260806 15:08:14.413523 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:14.413702 29974 external_mini_cluster.cc:1428] Setting key 72fae655bc43dd35f5f87b5510846a55
I20260806 15:08:14.414108 6030 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:14.416823 6030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Bootstrap starting.
I20260806 15:08:14.417424 6030 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:14.417716 6030 log.cc:824] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:14.418447 6030 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: No bootstrap required, opened a new log
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:14.420495 6030 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:14.420629 6030 raft_consensus.cc:374] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:14.420652 6030 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e0881817d944beb0a2364c488e8a96, State: Initialized, Role: FOLLOWER
I20260806 15:08:14.420792 6030 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:14.420866 6030 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:14.420887 6030 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:14.420961 6030 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:14.421463 6030 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:14.421556 6030 leader_election.cc:302] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3e0881817d944beb0a2364c488e8a96; no voters:
I20260806 15:08:14.421736 6030 leader_election.cc:288] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:14.421772 6035 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:14.421913 6035 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 LEADER]: Becoming Leader. State: Replica: c3e0881817d944beb0a2364c488e8a96, State: Running, Role: LEADER
I20260806 15:08:14.421999 6030 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:14.422009 6035 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:14.422428 6035 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3e0881817d944beb0a2364c488e8a96. Latest consensus state: current_term: 1 leader_uuid: "c3e0881817d944beb0a2364c488e8a96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } } }
I20260806 15:08:14.422519 6035 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:14.422439 6036 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c3e0881817d944beb0a2364c488e8a96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } } }
I20260806 15:08:14.422684 6036 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:14.422796 6041 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:14.423424 6041 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:14.424927 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.414246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58696 (local address 127.29.69.190:42785)
0806 15:08:14.414465 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:14.414475 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:14.414512 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:08:14.415170 (+ 658us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:14.415177 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:14.415222 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:14.415362 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:14.415983 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.416864 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.417687 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.418138 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.418255 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.420860 (+ 2605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:14.420866 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:14.420866 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:14.420879 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:14.423014 (+ 2135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.423452 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.423455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.423455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.423550 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.423923 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.423924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.423924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.424219 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:14.424322 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:14.424593 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 15:08:14.424727 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":114,"threads_started":1}
I20260806 15:08:14.427354 6041 catalog_manager.cc:1347] Generated new cluster ID: f58695ab63e6439b80832929c3c7d062
I20260806 15:08:14.427412 6041 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:14.445540 6041 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:14.446099 6041 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:14.451535 6041 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Generated new TSK 0
I20260806 15:08:14.451726 6041 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:08:14.476914 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42785
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:14.557265 6056 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:14.557459 6056 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:14.557483 6056 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:14.558652 6056 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:14.558691 6056 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:14.558717 6056 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:14.560117 6056 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6056
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:14.560343 6056 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:14.560577 6056 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:14.565534 6064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.565522 6061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.565526 6062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:14.565722 6056 server_base.cc:1034] running on GCE node
I20260806 15:08:14.565956 6056 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:14.566207 6056 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:14.567346 6056 hybrid_clock.cc:648] HybridClock initialized: now 1786028894567340 us; error 31 us; skew 500 ppm
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:14.569715 6056 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:08:14.570165 6056 webserver.cc:460] Webserver started at http://127.29.69.129:37743/ using document root <none> and password file <none>
I20260806 15:08:14.570427 6056 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:14.570493 6056 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:14.570626 6056 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:14.571676 6056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "1b539fa661774207b38716b71fe85c12"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "87b1e8f8becb6e9420328676f6a1f4bb"
server_key_iv: "d955b69902ea957b37d1a493620865e6"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.572028 6056 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "1b539fa661774207b38716b71fe85c12"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "87b1e8f8becb6e9420328676f6a1f4bb"
server_key_iv: "d955b69902ea957b37d1a493620865e6"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.573310 6056 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:14.574050 6071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.574234 6056 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:14.574352 6056 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "1b539fa661774207b38716b71fe85c12"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "87b1e8f8becb6e9420328676f6a1f4bb"
server_key_iv: "d955b69902ea957b37d1a493620865e6"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.574432 6056 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:14.601805 6056 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:14.603664 6056 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:14.603829 6056 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:14.604081 6056 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:14.604396 6056 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:14.604450 6056 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.604490 6056 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:14.604518 6056 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.610253 6056 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:46321
I20260806 15:08:14.610330 6187 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:46321 every 8 connection(s)
I20260806 15:08:14.610621 6056 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:14.611560 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6056
I20260806 15:08:14.611649 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:14.611855 29974 external_mini_cluster.cc:1428] Setting key ad9bc2d294e144be0a18ac5cdc8bde91
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
I20260806 15:08:14.620904 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.611293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:45583 (local address 127.29.69.190:42785)
0806 15:08:14.611387 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:14.611390 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:14.611595 (+ 205us) server_negotiation.cc:407] Connection header received
0806 15:08:14.612312 (+ 717us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:14.612313 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:14.612325 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:14.612384 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:14.613373 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.614117 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.615178 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.615539 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.615620 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.617731 (+ 2111us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:14.617733 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:14.617733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:14.617742 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:14.619543 (+ 1801us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.620020 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.620021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.620021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.620088 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.620339 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.620340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.620340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.620467 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:14.620523 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:14.620761 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 15:08:14.620829 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:08:14.621076 6190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.611256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:45583)
0806 15:08:14.611469 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:14.611504 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:14.612212 (+ 708us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:14.612472 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:14.612476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:14.613083 (+ 607us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:14.613270 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:14.613274 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.614222 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.614223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:14.615080 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:14.615083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.615636 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.615637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:14.615750 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.616300 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:14.616307 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:14.617630 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:14.619715 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:14.619721 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:14.619723 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:14.619934 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:14.620162 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:14.620163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:14.620163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:14.620265 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:14.620532 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:14.620537 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:14.620646 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 15:08:14.620729 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 15:08:14.620845 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":90,"threads_started":1}
I20260806 15:08:14.621606 6188 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42785
I20260806 15:08:14.621699 6188 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:14.621893 6188 heartbeater.cc:511] Master 127.29.69.190:42785 requested a full tablet report, sending...
I20260806 15:08:14.622452 5992 ts_manager.cc:194] Registered new tserver with Master: 1b539fa661774207b38716b71fe85c12 (127.29.69.129:46321)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
I20260806 15:08:14.623369 5992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:45583
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:08:14.636826 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42785
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:14.717679 6193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:14.717868 6193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:14.717891 6193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:14.719056 6193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:14.719096 6193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:14.719123 6193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:14.720570 6193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:14.720777 6193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:14.721004 6193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:14.726106 6201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.726091 6203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.726187 6199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:14.726408 6193 server_base.cc:1034] running on GCE node
I20260806 15:08:14.726641 6193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:14.726881 6193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:14.728070 6193 hybrid_clock.cc:648] HybridClock initialized: now 1786028894728055 us; error 24 us; skew 500 ppm
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:14.730554 6193 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:08:14.731009 6193 webserver.cc:460] Webserver started at http://127.29.69.130:44935/ using document root <none> and password file <none>
I20260806 15:08:14.731254 6193 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:14.731323 6193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:14.731467 6193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:14.732474 6193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "d1dba97392434944b1053f2ca0ef7f10"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "40fb9f1b8188f362f0e9139159279e6f"
server_key_iv: "59829aac41fcbeca50e9331a8f9a55ac"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.732918 6193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "d1dba97392434944b1053f2ca0ef7f10"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "40fb9f1b8188f362f0e9139159279e6f"
server_key_iv: "59829aac41fcbeca50e9331a8f9a55ac"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.734355 6193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:14.735117 6210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.735289 6193 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:14.735389 6193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "d1dba97392434944b1053f2ca0ef7f10"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "40fb9f1b8188f362f0e9139159279e6f"
server_key_iv: "59829aac41fcbeca50e9331a8f9a55ac"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.735481 6193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:14.750340 6193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:14.752043 6193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:14.752220 6193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:14.752447 6193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:14.752746 6193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:14.752799 6193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.752840 6193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:14.752868 6193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.758736 6193 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:46179
I20260806 15:08:14.758788 6325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:46179 every 8 connection(s)
I20260806 15:08:14.759078 6193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:14.761613 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6193
I20260806 15:08:14.761713 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:14.761891 29974 external_mini_cluster.cc:1428] Setting key 6ad1b531aba2d948dac339bb730db445
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:14.769275 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.759721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:37251 (local address 127.29.69.190:42785)
0806 15:08:14.759800 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:14.759802 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:14.760000 (+ 198us) server_negotiation.cc:407] Connection header received
0806 15:08:14.760434 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:14.760436 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:14.760446 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:14.760496 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:14.761320 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.762098 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.763286 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.763606 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.763683 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.766393 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:14.766395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:14.766395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:14.766406 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:14.767799 (+ 1393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.768314 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.768315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.768315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.768367 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.768672 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.768672 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.768672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.768769 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:14.768818 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:14.769143 (+ 325us) server_negotiation.cc:299] Negotiation successful
0806 15:08:14.769210 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 15:08:14.769547 6328 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.759685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:37251)
0806 15:08:14.759881 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:14.759915 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:14.760356 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:14.760544 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:14.760547 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:14.761071 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:14.761248 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:14.761252 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.762195 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.762196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:14.763189 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:14.763192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.763693 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.763694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:14.763798 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.764347 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:14.764357 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:14.766289 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:14.767888 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:14.767898 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:14.767900 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:14.768236 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:14.768437 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:14.768438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:14.768439 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:14.768605 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:14.768835 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:14.768843 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:14.769006 (+ 163us) client_negotiation.cc:769] Sending connection context
0806 15:08:14.769126 (+ 120us) client_negotiation.cc:240] Negotiation successful
0806 15:08:14.769304 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":104,"threads_started":1}
I20260806 15:08:14.770110 6326 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42785
I20260806 15:08:14.770200 6326 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:14.770426 6326 heartbeater.cc:511] Master 127.29.69.190:42785 requested a full tablet report, sending...
I20260806 15:08:14.770839 5992 ts_manager.cc:194] Registered new tserver with Master: d1dba97392434944b1053f2ca0ef7f10 (127.29.69.130:46179)
I20260806 15:08:14.771245 5992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:37251
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:08:14.787266 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42785
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:14.866581 6331 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:14.866813 6331 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:14.866849 6331 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:14.867986 6331 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:14.868063 6331 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:14.868109 6331 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:14.869535 6331 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6331
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:14.869797 6331 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:14.870031 6331 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:14.875276 6337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:14.875290 6336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:14.875308 6331 server_base.cc:1034] running on GCE node
W20260806 15:08:14.875290 6339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:14.875670 6331 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:14.875912 6331 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:14.877106 6331 hybrid_clock.cc:648] HybridClock initialized: now 1786028894877089 us; error 49 us; skew 500 ppm
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:14.879551 6331 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:08:14.880005 6331 webserver.cc:460] Webserver started at http://127.29.69.131:37413/ using document root <none> and password file <none>
I20260806 15:08:14.880235 6331 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:14.880302 6331 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:14.880455 6331 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:14.881467 6331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "1bd4e2d811514ab5bf09d7c79a0e52e4"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "1d9c4cc2850050695ec9a7b5e6418e5d"
server_key_iv: "bad614adb387cdf2bc23efcc78772991"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.881824 6331 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "1bd4e2d811514ab5bf09d7c79a0e52e4"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "1d9c4cc2850050695ec9a7b5e6418e5d"
server_key_iv: "bad614adb387cdf2bc23efcc78772991"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.883211 6331 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:14.883946 6347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.884124 6331 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:14.884229 6331 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "1bd4e2d811514ab5bf09d7c79a0e52e4"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "1d9c4cc2850050695ec9a7b5e6418e5d"
server_key_iv: "bad614adb387cdf2bc23efcc78772991"
server_key_version: "encryptionkey@0"
I20260806 15:08:14.884302 6331 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:14.898852 6331 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:14.900569 6331 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:14.900735 6331 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:14.900967 6331 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:14.901273 6331 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:14.901329 6331 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.901371 6331 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:14.901399 6331 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:14.907169 6331 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36893
I20260806 15:08:14.907219 6462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36893 every 8 connection(s)
I20260806 15:08:14.907513 6331 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:14.911677 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6331
I20260806 15:08:14.911785 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:14.911948 29974 external_mini_cluster.cc:1428] Setting key 37b666e8af2a7a4374e38d9fcc6ba477
Aug 06 15:08:14 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028894, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:14.916586 6033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.908234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:55303 (local address 127.29.69.190:42785)
0806 15:08:14.908341 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:14.908343 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:14.908498 (+ 155us) server_negotiation.cc:407] Connection header received
0806 15:08:14.909059 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:14.909061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:14.909073 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:14.909131 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:14.910063 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.910652 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.911669 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.911955 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.912036 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.914129 (+ 2093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:14.914130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:14.914130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:14.914137 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:14.915372 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.915756 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.915757 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.915757 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.915810 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:14.916016 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:14.916017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:14.916017 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:14.916121 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:14.916171 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:14.916450 (+ 279us) server_negotiation.cc:299] Negotiation successful
0806 15:08:14.916520 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260806 15:08:14.916642 6465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:14.908149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:55303)
0806 15:08:14.908358 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:14.908403 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:14.908908 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:14.909202 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:14.909206 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:14.909771 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:14.909958 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:14.909962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.910745 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.910746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:14.911569 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:14.911570 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:14.912068 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:14.912069 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:14.912206 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:14.912716 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:14.912724 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:14.914044 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:14.915455 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:14.915462 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:14.915464 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:14.915690 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:14.915869 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:14.915869 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:14.915870 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:14.915961 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:14.916176 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:14.916180 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:14.916286 (+ 106us) client_negotiation.cc:769] Sending connection context
0806 15:08:14.916367 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 15:08:14.916481 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":89,"threads_started":1}
I20260806 15:08:14.917138 6463 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42785
I20260806 15:08:14.917217 6463 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:14.917408 6463 heartbeater.cc:511] Master 127.29.69.190:42785 requested a full tablet report, sending...
I20260806 15:08:14.917794 5992 ts_manager.cc:194] Registered new tserver with Master: 1bd4e2d811514ab5bf09d7c79a0e52e4 (127.29.69.131:36893)
I20260806 15:08:14.918179 5992 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:55303
I20260806 15:08:14.923692 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab.
Entry for principal oryx/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab.
WARNING: no policy specified for oryx/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab.
Entry for principal oryx/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab.
WARNING: no policy specified for oryx/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab.
Entry for principal oryx/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab.
I20260806 15:08:14.992249 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6056
I20260806 15:08:14.998186 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6193
I20260806 15:08:15.003006 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6331
I20260806 15:08:15.007622 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 5960
I20260806 15:08:15.013252 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42785
--webserver_interface=127.29.69.190
--webserver_port=44941
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:42785
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:15.093403 6472 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:15.093657 6472 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:15.093698 6472 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:15.094892 6472 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:15.094964 6472 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:15.094990 6472 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:15.095018 6472 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:15.095042 6472 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:15.096884 6472 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:42785
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42785
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=44941
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6472
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:15.097194 6472 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:15.097429 6472 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:15.102358 6478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.102363 6472 server_base.cc:1034] running on GCE node
W20260806 15:08:15.102342 6477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:15.102296 6480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.102752 6472 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:15.103057 6472 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:15.104229 6472 hybrid_clock.cc:648] HybridClock initialized: now 1786028895104216 us; error 41 us; skew 500 ppm
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028895, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:15.106699 6472 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:08:15.107192 6472 webserver.cc:460] Webserver started at http://127.29.69.190:44941/ using document root <none> and password file <none>
I20260806 15:08:15.107426 6472 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:15.107512 6472 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:15.108901 6472 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:15.109547 6487 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.109719 6472 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:15.109823 6472 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "c3e0881817d944beb0a2364c488e8a96"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "58d0cc7f9669f71fdfd2517f3aae407f"
server_key_iv: "b0f460b24b7933cf2d64520c0bb8f240"
server_key_version: "encryptionkey@0"
I20260806 15:08:15.110174 6472 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:15.137414 6472 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:15.139382 6472 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:15.139557 6472 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:15.143666 6472 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:42785
I20260806 15:08:15.143708 6541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:42785 every 8 connection(s)
I20260806 15:08:15.144100 6472 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:15.145545 6542 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:08:15.146143 6542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Bootstrap starting.
I20260806 15:08:15.148206 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6472
I20260806 15:08:15.148550 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:46321
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:42785
--webserver_port=37743
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:08:15.155488 6542 log.cc:824] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:15.157120 6542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:08:15.157424 6542 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Bootstrap complete.
I20260806 15:08:15.159736 6542 raft_consensus.cc:348] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:15.159963 6542 raft_consensus.cc:729] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3e0881817d944beb0a2364c488e8a96, State: Initialized, Role: FOLLOWER
I20260806 15:08:15.160130 6542 consensus_queue.cc:260] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:15.160199 6542 raft_consensus.cc:388] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:15.160259 6542 raft_consensus.cc:482] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:15.160302 6542 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:08:15.161298 6542 raft_consensus.cc:504] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:15.161382 6542 leader_election.cc:302] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c3e0881817d944beb0a2364c488e8a96; no voters:
I20260806 15:08:15.161576 6542 leader_election.cc:288] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 15:08:15.161641 6546 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:08:15.161790 6546 raft_consensus.cc:686] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [term 2 LEADER]: Becoming Leader. State: Replica: c3e0881817d944beb0a2364c488e8a96, State: Running, Role: LEADER
I20260806 15:08:15.161847 6542 sys_catalog.cc:564] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:15.161882 6546 consensus_queue.cc:237] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } }
I20260806 15:08:15.162148 6546 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c3e0881817d944beb0a2364c488e8a96. Latest consensus state: current_term: 2 leader_uuid: "c3e0881817d944beb0a2364c488e8a96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } } }
I20260806 15:08:15.162214 6546 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:15.162168 6547 sys_catalog.cc:455] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c3e0881817d944beb0a2364c488e8a96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c3e0881817d944beb0a2364c488e8a96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42785 } } }
I20260806 15:08:15.162426 6547 sys_catalog.cc:458] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:15.162417 6551 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:15.162942 6551 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:15.163077 6551 catalog_manager.cc:1259] Loaded cluster ID: f58695ab63e6439b80832929c3c7d062
I20260806 15:08:15.163115 6551 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:15.164384 6551 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:15.164561 6551 catalog_manager.cc:5879] T 00000000000000000000000000000000 P c3e0881817d944beb0a2364c488e8a96: Loaded TSK: 0
I20260806 15:08:15.164768 6551 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:08:15.230921 6544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:15.231118 6544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:15.231142 6544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:15.232324 6544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:15.232368 6544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:15.232395 6544 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:15.233929 6544 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.129.keytab
--principal=oryx/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:46321
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=37743
--tserver_master_addrs=127.29.69.190:42785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:15.234171 6544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:15.234447 6544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:15.240260 6570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:15.240262 6569 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.240413 6544 server_base.cc:1034] running on GCE node
W20260806 15:08:15.240551 6572 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.240767 6544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:15.241021 6544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:15.242190 6544 hybrid_clock.cc:648] HybridClock initialized: now 1786028895242177 us; error 32 us; skew 500 ppm
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028895, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:15.244832 6544 init.cc:377] Logged in from keytab as oryx/127.29.69.129@KRBTEST.COM (short username oryx)
I20260806 15:08:15.245328 6544 webserver.cc:460] Webserver started at http://127.29.69.129:37743/ using document root <none> and password file <none>
I20260806 15:08:15.245582 6544 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:15.245668 6544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:15.247130 6544 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:08:15.247788 6579 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.247988 6544 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:15.248108 6544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "1b539fa661774207b38716b71fe85c12"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "87b1e8f8becb6e9420328676f6a1f4bb"
server_key_iv: "d955b69902ea957b37d1a493620865e6"
server_key_version: "encryptionkey@0"
I20260806 15:08:15.248456 6544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:15.257164 6544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:15.259429 6544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:15.259593 6544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:15.259824 6544 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:15.260183 6544 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:15.260239 6544 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.260280 6544 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:15.260306 6544 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.266775 6544 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:46321
I20260806 15:08:15.266855 6692 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:46321 every 8 connection(s)
I20260806 15:08:15.267191 6544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:15.273763 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6544
I20260806 15:08:15.274094 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:46179
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:42785
--webserver_port=44935
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.276698 6696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.267977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:50655)
0806 15:08:15.268156 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.268197 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.268664 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.269141 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.269144 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.269693 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.269875 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.269880 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.271602 (+ 1722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.271603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.272364 (+ 761us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.272366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.273171 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.273171 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.273268 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.273825 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.273835 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.276482 (+ 2647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
W20260806 15:08:15.276773 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.268075 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:50655 (local address 127.29.69.190:42785)
0806 15:08:15.268268 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.268277 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.268311 (+ 34us) server_negotiation.cc:407] Connection header received
0806 15:08:15.268874 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.268881 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.268937 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.269103 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.270020 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.271502 (+ 1482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.272465 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.273075 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.273191 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.276606 (+ 3415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:50655: BlockingRecv error: recv got EOF from 127.29.69.129:50655 (error 108)
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":84,"threads_started":1}
W20260806 15:08:15.277222 6693 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:42785 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.69.190:42785: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.281782 6696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.277491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:43379)
0806 15:08:15.277529 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.277540 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.277583 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.277723 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.277724 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.277845 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.277887 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.277888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.278586 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.278587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.279085 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.279087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.279586 (+ 499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.279586 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.279661 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.280090 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.280095 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.281704 (+ 1609us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":15}
W20260806 15:08:15.281836 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.277522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:43379 (local address 127.29.69.190:42785)
0806 15:08:15.277566 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.277568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.277577 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:08:15.277642 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.277643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.277655 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.277705 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.277971 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.278510 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.279172 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.279510 (+ 338us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.279588 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.281775 (+ 2187us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:43379: BlockingRecv error: recv got EOF from 127.29.69.129:43379 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.286273 6696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.282267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:53865)
0806 15:08:15.282404 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.282415 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.282462 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.282587 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.282587 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.282714 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.282738 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.282739 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.283337 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.283338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.283822 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.283823 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.284200 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.284201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.284255 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.284649 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.284654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.286199 (+ 1545us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123}
W20260806 15:08:15.286341 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.282344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:53865 (local address 127.29.69.190:42785)
0806 15:08:15.282402 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.282404 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.282448 (+ 44us) server_negotiation.cc:407] Connection header received
0806 15:08:15.282518 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.282518 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.282529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.282583 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.282810 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.283257 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.283903 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.284118 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.284188 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.286265 (+ 2077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:53865: BlockingRecv error: recv got EOF from 127.29.69.129:53865 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260806 15:08:15.286712 6693 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:08:15.365303 6699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:15.365517 6699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:15.365540 6699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:15.366650 6699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:15.366684 6699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:15.366710 6699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:15.368062 6699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.130.keytab
--principal=oryx/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:46179
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=44935
--tserver_master_addrs=127.29.69.190:42785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6699
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:15.368244 6699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:15.368409 6699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:15.373292 6704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:15.373334 6707 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.373474 6699 server_base.cc:1034] running on GCE node
W20260806 15:08:15.373550 6705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.373742 6699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:15.373978 6699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:15.375162 6699 hybrid_clock.cc:648] HybridClock initialized: now 1786028895375160 us; error 39 us; skew 500 ppm
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028895, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:15.377592 6699 init.cc:377] Logged in from keytab as oryx/127.29.69.130@KRBTEST.COM (short username oryx)
I20260806 15:08:15.378005 6699 webserver.cc:460] Webserver started at http://127.29.69.130:44935/ using document root <none> and password file <none>
I20260806 15:08:15.378243 6699 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:15.378350 6699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:15.379714 6699 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:15.380337 6714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.380501 6699 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:15.380601 6699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "d1dba97392434944b1053f2ca0ef7f10"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "40fb9f1b8188f362f0e9139159279e6f"
server_key_iv: "59829aac41fcbeca50e9331a8f9a55ac"
server_key_version: "encryptionkey@0"
I20260806 15:08:15.380928 6699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:15.389830 6699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:15.391748 6699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:15.391914 6699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:15.392134 6699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:15.392438 6699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:15.392493 6699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.392527 6699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:15.392554 6699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.398514 6699 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:46179
I20260806 15:08:15.398567 6830 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:46179 every 8 connection(s)
I20260806 15:08:15.398877 6699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:15.400256 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6699
I20260806 15:08:15.400538 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:36893
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:42785
--webserver_port=37413
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46525
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 15:08:15.406622 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.399535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:57137 (local address 127.29.69.190:42785)
0806 15:08:15.399601 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.399603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.399808 (+ 205us) server_negotiation.cc:407] Connection header received
0806 15:08:15.400309 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.400311 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.400327 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.400384 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.401358 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.401860 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.402943 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.403179 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.403241 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.406566 (+ 3325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:57137: BlockingRecv error: recv got EOF from 127.29.69.130:57137 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:08:15.406682 6833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.399551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:57137)
0806 15:08:15.399687 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.399722 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.400203 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.400459 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.400462 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.401075 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.401258 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.401262 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.401967 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.401968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.402841 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.402844 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.403275 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.403277 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.403433 (+ 156us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.403985 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.403996 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.406493 (+ 2497us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
W20260806 15:08:15.406919 6831 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:42785 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.69.190:42785: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.411199 6833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.407128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:36853)
0806 15:08:15.407185 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.407195 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.407233 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.407350 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.407351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.407478 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.407519 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.407521 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.408126 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.408127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.408623 (+ 496us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.408624 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.408989 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.408990 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.409058 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.409476 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.409481 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.411122 (+ 1641us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":40}
W20260806 15:08:15.411253 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.407196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:36853 (local address 127.29.69.190:42785)
0806 15:08:15.407259 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.407261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.407269 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:15.407292 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.407293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.407301 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.407349 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.407592 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.408047 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.408713 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.408906 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.408987 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.411193 (+ 2206us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:36853: BlockingRecv error: recv got EOF from 127.29.69.130:36853 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.416285 6833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.411556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:35269)
0806 15:08:15.411604 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.411616 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.411654 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.411797 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.411798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.411904 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.411928 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.411929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.412808 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.412809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.413633 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.413635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.414081 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.414082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.414135 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.414547 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.414552 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.416210 (+ 1658us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 15:08:15.416337 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.411631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:35269 (local address 127.29.69.190:42785)
0806 15:08:15.411685 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.411687 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.411695 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:15.411716 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.411717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.411726 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.411796 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.411987 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.412713 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.413725 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.413993 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.414057 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.416278 (+ 2221us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:35269: BlockingRecv error: recv got EOF from 127.29.69.130:35269 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260806 15:08:15.416433 6831 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:08:15.483430 6834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:15.483670 6834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:15.483707 6834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:15.484946 6834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:15.485006 6834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:15.485064 6834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:15.486582 6834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46525
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/krb5kdc/oryx_127.29.69.131.keytab
--principal=oryx/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:36893
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=37413
--tserver_master_addrs=127.29.69.190:42785
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:15.486850 6834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:15.487080 6834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:15.492264 6839 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:15.492270 6842 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:15.492280 6840 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:15.492466 6834 server_base.cc:1034] running on GCE node
I20260806 15:08:15.492698 6834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:15.492962 6834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:15.494120 6834 hybrid_clock.cc:648] HybridClock initialized: now 1786028895494103 us; error 36 us; skew 500 ppm
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028895, etypes {rep=17 tkt=17 ses=17}, oryx/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:15.496558 6834 init.cc:377] Logged in from keytab as oryx/127.29.69.131@KRBTEST.COM (short username oryx)
I20260806 15:08:15.497033 6834 webserver.cc:460] Webserver started at http://127.29.69.131:37413/ using document root <none> and password file <none>
I20260806 15:08:15.497265 6834 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:15.497341 6834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:15.498725 6834 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:15.499362 6849 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.499549 6834 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:15.499640 6834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "1bd4e2d811514ab5bf09d7c79a0e52e4"
format_stamp: "Formatted at 2026-08-06 15:08:14 on dist-test-slave-tm1g"
server_key: "1d9c4cc2850050695ec9a7b5e6418e5d"
server_key_iv: "bad614adb387cdf2bc23efcc78772991"
server_key_version: "encryptionkey@0"
I20260806 15:08:15.499956 6834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:15.514467 6834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:15.516248 6834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:15.516398 6834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:15.516610 6834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:15.516911 6834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:15.516944 6834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.516965 6834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:15.517011 6834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:15.522878 6834 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36893
I20260806 15:08:15.522933 6965 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36893 every 8 connection(s)
I20260806 15:08:15.523245 6834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:15.525673 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 6834
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
W20260806 15:08:15.531111 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.523880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:55037 (local address 127.29.69.190:42785)
0806 15:08:15.523960 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.523963 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.524222 (+ 259us) server_negotiation.cc:407] Connection header received
0806 15:08:15.524676 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.524677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.524687 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.524739 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.525767 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.526502 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.527760 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.527934 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.527982 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.531043 (+ 3061us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:55037: BlockingRecv error: recv got EOF from 127.29.69.131:55037 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 15:08:15.531185 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.523873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:55037)
0806 15:08:15.524065 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.524100 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.524586 (+ 486us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.524802 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.524806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.525368 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.525649 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.525656 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.526610 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.526611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.527669 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.527673 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.528015 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.528017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.528154 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.528629 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.528640 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.530946 (+ 2306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":116,"threads_started":1}
W20260806 15:08:15.531409 6966 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:42785 (0 consecutive failures): Not authorized: Failed to ping master at 127.29.69.190:42785: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
I20260806 15:08:15.533386 6970 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.526189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58700 (local address 127.29.69.190:42785)
0806 15:08:15.526330 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.526333 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.526340 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:15.526361 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.526362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.526372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.526439 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.527164 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.527611 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.528636 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.528822 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.528872 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.530063 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:15.530067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:15.530068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:15.530079 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:15.531958 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:15.532343 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:15.532346 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:15.532346 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:15.532465 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:15.532651 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:15.532652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:15.532653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:15.532934 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:15.533037 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:15.533244 (+ 207us) server_negotiation.cc:299] Negotiation successful
0806 15:08:15.533327 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":63,"threads_started":1}
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.536572 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.531640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:34617)
0806 15:08:15.531721 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.531731 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.531771 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.531897 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.531898 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.532065 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.532118 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.532119 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.532935 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.532936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.533976 (+ 1040us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.533980 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.534457 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.534458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.534518 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.534975 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.534980 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.536527 (+ 1547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":51}
W20260806 15:08:15.536659 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.531692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:34617 (local address 127.29.69.190:42785)
0806 15:08:15.531746 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.531748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.531758 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:08:15.531828 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.531829 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.531838 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.531892 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.532194 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.532828 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.534069 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.534385 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.534453 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.536605 (+ 2152us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:34617: BlockingRecv error: recv got EOF from 127.29.69.131:34617 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:15 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:15.540818 6968 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:15.536855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:42939)
0806 15:08:15.536904 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:15.536914 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:15.536953 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:15.537119 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:15.537120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:15.537245 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:15.537269 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.537270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.537869 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.537870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.538428 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:15.538430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.538774 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.538775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:15.538828 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.539176 (+ 348us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:15.539180 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:15.540776 (+ 1596us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 15:08:15.540931 6697 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:15.536944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:42939 (local address 127.29.69.190:42785)
0806 15:08:15.537005 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:15.537007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:15.537014 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:15.537036 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:15.537037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:15.537044 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:15.537116 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:15.537341 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.537789 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.538508 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:15.538692 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:15.538773 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:15.540850 (+ 2077us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:42939: BlockingRecv error: recv got EOF from 127.29.69.131:42939 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260806 15:08:15.540956 6966 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 06 15:08:16 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:16 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:16.291734 6971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:16.287086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:52917)
0806 15:08:16.287240 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:16.287251 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:16.287304 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:16.287444 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:16.287445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:16.287610 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:16.287668 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:16.287670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.288315 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.288316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:16.288888 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:16.288890 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.289313 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.289314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:16.289362 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:16.289815 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:16.289820 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:16.291667 (+ 1847us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
W20260806 15:08:16.291880 6972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:16.287173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:52917 (local address 127.29.69.190:42785)
0806 15:08:16.287297 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:16.287299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:16.287307 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:16.287358 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:16.287358 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:16.287367 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:16.287425 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:16.287731 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.288240 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.288997 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.289203 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.289316 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:16.291786 (+ 2470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:52917: BlockingRecv error: recv got EOF from 127.29.69.129:52917 (error 108)
Metrics: {"server-negotiator.queue_time_us":95,"thread_start_us":67,"threads_started":1}
Aug 06 15:08:16 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:16 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:16.421752 6973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:16.416850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:43099)
0806 15:08:16.417002 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:16.417012 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:16.417064 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:16.417210 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:16.417211 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:16.417383 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:16.417434 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:16.417435 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.418102 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.418103 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:16.418743 (+ 640us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:16.418746 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.419137 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.419138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:16.419192 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:16.419769 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:16.419776 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:16.421683 (+ 1907us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
W20260806 15:08:16.421890 6972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:16.416936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:43099 (local address 127.29.69.190:42785)
0806 15:08:16.417018 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:16.417020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:16.417052 (+ 32us) server_negotiation.cc:407] Connection header received
0806 15:08:16.417124 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:16.417124 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:16.417135 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:16.417189 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:16.417496 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.418013 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.418837 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.419045 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.419109 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:16.421809 (+ 2700us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:43099: BlockingRecv error: recv got EOF from 127.29.69.130:43099 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Aug 06 15:08:16 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:16 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:16.546586 6974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:16.541327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:40643)
0806 15:08:16.541475 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:16.541486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:16.541548 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:16.541703 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:16.541704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:16.541853 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:16.541905 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:16.541907 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.543007 (+ 1100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.543008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:16.543560 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:16.543561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.544107 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.544108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:16.544149 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:16.544649 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:16.544654 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:16.546516 (+ 1862us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
W20260806 15:08:16.546773 6972 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:16.541421 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:40643 (local address 127.29.69.190:42785)
0806 15:08:16.541509 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:16.541511 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:16.541545 (+ 34us) server_negotiation.cc:407] Connection header received
0806 15:08:16.541599 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:16.541600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:16.541617 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:16.541697 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:16.541979 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.542904 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.543642 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:16.544020 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:16.544101 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:16.546637 (+ 2536us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:40643: BlockingRecv error: recv got EOF from 127.29.69.131:40643 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
Aug 06 15:08:17 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:17 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:17.296922 6975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:17.292199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:35169)
0806 15:08:17.292352 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:17.292365 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:17.292432 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:17.292585 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:17.292586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:17.292742 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:17.292796 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:17.292798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.293439 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.293440 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:17.293966 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:17.293968 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.294374 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.294375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:17.294419 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:17.294916 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:17.294921 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:17.296802 (+ 1881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
W20260806 15:08:17.296962 6976 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:17.292260 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:35169 (local address 127.29.69.190:42785)
0806 15:08:17.292390 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:17.292392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:17.292417 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:08:17.292490 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:17.292491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:17.292501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:17.292564 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:17.292861 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.293375 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.294063 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.294267 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.294365 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:17.296907 (+ 2542us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:35169: BlockingRecv error: recv got EOF from 127.29.69.129:35169 (error 108)
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":84,"threads_started":1}
Aug 06 15:08:17 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:17 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:17.427170 6977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:17.422213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:40695)
0806 15:08:17.422394 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:17.422408 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:17.422482 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:17.422654 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:17.422654 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:17.422859 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:17.422911 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:17.422913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.423613 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.423614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:17.424171 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:17.424172 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.424663 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.424664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:17.424745 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:17.425265 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:17.425271 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:17.427094 (+ 1823us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
W20260806 15:08:17.427309 6976 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:17.422339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:40695 (local address 127.29.69.190:42785)
0806 15:08:17.422398 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:17.422401 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:17.422465 (+ 64us) server_negotiation.cc:407] Connection header received
0806 15:08:17.422550 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:17.422551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:17.422569 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:17.422629 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:17.423010 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.423526 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.424260 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.424570 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.424651 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:17.427224 (+ 2573us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:40695: BlockingRecv error: recv got EOF from 127.29.69.130:40695 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 06 15:08:17 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:17 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:17.551833 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:17.547083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:37727)
0806 15:08:17.547245 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:17.547258 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:17.547328 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:17.547498 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:17.547500 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:17.547689 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:17.547755 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:17.547757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.548450 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.548451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:17.549011 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:17.549014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.549383 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.549385 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:17.549462 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:17.549940 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:17.549944 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:17.551774 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
W20260806 15:08:17.551990 6976 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:17.547229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:37727 (local address 127.29.69.190:42785)
0806 15:08:17.547281 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:17.547283 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:17.547308 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:08:17.547400 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:17.547401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:17.547415 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:17.547490 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:17.547839 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.548367 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.549101 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:17.549300 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:17.549378 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:17.551895 (+ 2517us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:37727: BlockingRecv error: recv got EOF from 127.29.69.131:37727 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Aug 06 15:08:18 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:18 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:18.302423 6979 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:18.297459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:41707)
0806 15:08:18.297599 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:18.297617 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:18.297667 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:18.297806 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:18.297807 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:18.297968 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:18.298021 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:18.298023 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.298714 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.298716 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:18.299276 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:18.299278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.299639 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.299640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:18.299691 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:18.300145 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:18.300151 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:18.302286 (+ 2135us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
W20260806 15:08:18.302450 6980 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:18.297532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:41707 (local address 127.29.69.190:42785)
0806 15:08:18.297674 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:18.297677 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:18.297693 (+ 16us) server_negotiation.cc:407] Connection header received
0806 15:08:18.297716 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:18.297717 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:18.297728 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:18.297790 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:18.298090 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.298627 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.299355 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.299558 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.299613 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:18.302386 (+ 2773us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:41707: BlockingRecv error: recv got EOF from 127.29.69.129:41707 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":87,"threads_started":1}
Aug 06 15:08:18 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:18 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:18.432516 6981 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:18.427648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:39537)
0806 15:08:18.427885 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:18.427897 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:18.427997 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:18.428157 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:18.428158 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:18.428349 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:18.428404 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:18.428406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.429121 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.429122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:18.429655 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:18.429656 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.430033 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.430034 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:18.430103 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:18.430692 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:18.430697 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:18.432457 (+ 1760us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":209,"thread_start_us":114,"threads_started":1}
W20260806 15:08:18.432669 6980 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:18.427760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:39537 (local address 127.29.69.190:42785)
0806 15:08:18.427858 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:18.427861 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:18.427979 (+ 118us) server_negotiation.cc:407] Connection header received
0806 15:08:18.428059 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:18.428060 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:18.428075 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:18.428147 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:18.428500 (+ 353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.429022 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.429741 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.429945 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.430033 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:18.432579 (+ 2546us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:39537: BlockingRecv error: recv got EOF from 127.29.69.130:39537 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 15:08:18 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:18 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:18.556986 6982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:18.552385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:46263)
0806 15:08:18.552528 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:18.552547 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:18.552595 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:18.552728 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:18.552729 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:18.552896 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:18.552949 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:18.552951 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.553668 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.553669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:18.554220 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:18.554222 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.554642 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.554643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:18.554693 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:18.555151 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:18.555156 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:18.556925 (+ 1769us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
W20260806 15:08:18.557188 6980 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:18.552489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:46263 (local address 127.29.69.190:42785)
0806 15:08:18.552576 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:18.552580 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:18.552593 (+ 13us) server_negotiation.cc:407] Connection header received
0806 15:08:18.552654 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:18.552655 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:18.552665 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:18.552707 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:18.553052 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.553574 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.554358 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:18.554563 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:18.554620 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:18.557098 (+ 2478us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:46263: BlockingRecv error: recv got EOF from 127.29.69.131:46263 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
Aug 06 15:08:19 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:19 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:19.307670 6983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:19.302905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:47371)
0806 15:08:19.303133 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:19.303143 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:19.303198 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:19.303337 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:19.303338 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:19.303503 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:19.303557 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:19.303559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.304293 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.304294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:19.305006 (+ 712us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:19.305008 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.305349 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.305350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:19.305392 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:19.305839 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:19.305844 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:19.307610 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":203,"thread_start_us":175,"threads_started":1}
W20260806 15:08:19.307811 6984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:19.302988 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:47371 (local address 127.29.69.190:42785)
0806 15:08:19.303128 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:19.303130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:19.303182 (+ 52us) server_negotiation.cc:407] Connection header received
0806 15:08:19.303242 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:19.303243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:19.303252 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:19.303313 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:19.303626 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.304212 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.305080 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.305277 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.305331 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:19.307699 (+ 2368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:47371: BlockingRecv error: recv got EOF from 127.29.69.129:47371 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
Aug 06 15:08:19 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:19 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:19.443121 6985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:19.433063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:39959)
0806 15:08:19.433263 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:19.433275 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:19.433341 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:19.433466 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:19.433466 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:19.433633 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:19.433716 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:19.433719 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.434626 (+ 907us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.434627 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:19.435154 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:19.435155 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.435515 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.435516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:19.435555 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:19.441175 (+ 5620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:19.441180 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:19.443060 (+ 1880us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":110,"threads_started":1}
W20260806 15:08:19.443252 6984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:19.433129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:39959 (local address 127.29.69.190:42785)
0806 15:08:19.433200 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:19.433202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:19.433354 (+ 152us) server_negotiation.cc:407] Connection header received
0806 15:08:19.433383 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:19.433384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:19.433395 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:19.433446 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:19.433804 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.434557 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.435237 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.435447 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.435505 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:19.443170 (+ 7665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:39959: BlockingRecv error: recv got EOF from 127.29.69.130:39959 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 06 15:08:19 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:19 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:19.562273 6986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:19.557503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:58395)
0806 15:08:19.557649 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:19.557665 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:19.557721 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:19.557849 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:19.557850 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:19.558016 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:19.558069 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:19.558070 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.558830 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.558830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:19.559354 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:19.559356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.559674 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.559675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:19.559717 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:19.560244 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:19.560248 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:19.562151 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":89,"threads_started":1}
W20260806 15:08:19.562357 6984 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:19.557594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:58395 (local address 127.29.69.190:42785)
0806 15:08:19.557649 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:19.557651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:19.557708 (+ 57us) server_negotiation.cc:407] Connection header received
0806 15:08:19.557777 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:19.557778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:19.557788 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:19.557829 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:19.558162 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.558750 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.559422 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:19.559611 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:19.559664 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:19.562246 (+ 2582us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:58395: BlockingRecv error: recv got EOF from 127.29.69.131:58395 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
Aug 06 15:08:20 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:20 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:20.314765 6987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:20.308151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:43013)
0806 15:08:20.308285 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:20.308299 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:20.308372 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:20.308630 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:20.308632 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:20.308882 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:20.308960 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:20.308964 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.310124 (+ 1160us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.310126 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:20.311114 (+ 988us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:20.311118 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.311663 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.311665 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:20.311760 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:20.312255 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:20.312261 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:20.314667 (+ 2406us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":75,"threads_started":1}
W20260806 15:08:20.314819 6988 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:20.308351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:43013 (local address 127.29.69.190:42785)
0806 15:08:20.308480 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:20.308482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:20.308491 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:08:20.308521 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:20.308522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:20.308533 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:20.308592 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:20.309053 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.310026 (+ 973us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.311214 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.311572 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.311649 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:20.314745 (+ 3096us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:43013: BlockingRecv error: recv got EOF from 127.29.69.129:43013 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
Aug 06 15:08:20 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:20 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:20.448029 6989 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:20.443580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:60147)
0806 15:08:20.443721 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:20.443732 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:20.443778 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:20.443901 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:20.443902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:20.444062 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:20.444116 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:20.444118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.444752 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.444753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:20.445275 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:20.445276 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.445602 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.445603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:20.445647 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:20.446063 (+ 416us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:20.446067 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:20.447970 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
W20260806 15:08:20.448186 6988 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:20.443701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:60147 (local address 127.29.69.190:42785)
0806 15:08:20.443776 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:20.443778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:20.443786 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:20.443832 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:20.443833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:20.443843 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:20.443887 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:20.444178 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.444686 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.445353 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.445543 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.445592 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:20.448101 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:60147: BlockingRecv error: recv got EOF from 127.29.69.130:60147 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 06 15:08:20 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:20 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:20.572479 6990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:20.562898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:36113)
0806 15:08:20.563083 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:20.563097 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:20.563166 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:20.563319 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:20.563320 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:20.563542 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:20.563595 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:20.563598 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.564281 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.564281 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:20.564836 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:20.564838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.565219 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.565220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:20.565262 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:20.570444 (+ 5182us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:20.570449 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:20.572375 (+ 1926us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":90,"threads_started":1}
W20260806 15:08:20.572523 6988 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:20.562975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:36113 (local address 127.29.69.190:42785)
0806 15:08:20.563027 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:20.563030 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:20.563167 (+ 137us) server_negotiation.cc:407] Connection header received
0806 15:08:20.563227 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:20.563228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:20.563240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:20.563289 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:20.563680 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.564209 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.564934 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:20.565146 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:20.565211 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:20.572458 (+ 7247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:36113: BlockingRecv error: recv got EOF from 127.29.69.131:36113 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 15:08:21 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:21 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:21.320058 6991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:21.315410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:51393)
0806 15:08:21.315566 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:21.315577 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:21.315630 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:21.315800 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:21.315802 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:21.315972 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:21.316031 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:21.316032 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.316737 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.316738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:21.317301 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:21.317303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.317650 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.317651 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:21.317693 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:21.318165 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:21.318170 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:21.319987 (+ 1817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
W20260806 15:08:21.320212 6992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:21.315497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:51393 (local address 127.29.69.190:42785)
0806 15:08:21.315643 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:21.315645 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:21.315672 (+ 27us) server_negotiation.cc:407] Connection header received
0806 15:08:21.315694 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:21.315694 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:21.315704 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:21.315758 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:21.316115 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.316654 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.317378 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.317583 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.317639 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:21.320106 (+ 2467us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:51393: BlockingRecv error: recv got EOF from 127.29.69.129:51393 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
Aug 06 15:08:21 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:21 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:21.453423 6993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:21.448459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:54941)
0806 15:08:21.448650 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:21.448664 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:21.448753 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:21.448902 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:21.448903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:21.449091 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:21.449144 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:21.449146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.449834 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.449835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:21.450446 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:21.450448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.450846 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.450848 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:21.450911 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:21.451319 (+ 408us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:21.451323 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:21.453324 (+ 2001us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":103,"threads_started":1}
W20260806 15:08:21.453464 6992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:21.448566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:54941 (local address 127.29.69.190:42785)
0806 15:08:21.448656 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:21.448658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:21.448732 (+ 74us) server_negotiation.cc:407] Connection header received
0806 15:08:21.448832 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:21.448833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:21.448845 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:21.448898 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:21.449231 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.449746 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.450544 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.450751 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.450820 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:21.453403 (+ 2583us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:54941: BlockingRecv error: recv got EOF from 127.29.69.130:54941 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Aug 06 15:08:21 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:21 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:21.577371 6994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:21.572945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:57485)
0806 15:08:21.573085 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:21.573097 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:21.573159 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:21.573293 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:21.573294 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:21.573462 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:21.573513 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:21.573515 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.574146 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.574147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:21.574718 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:21.574720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.575058 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.575059 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:21.575101 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:21.575611 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:21.575616 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:21.577313 (+ 1697us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":85,"threads_started":1}
W20260806 15:08:21.577445 6992 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:21.573041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:57485 (local address 127.29.69.190:42785)
0806 15:08:21.573107 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:21.573109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:21.573156 (+ 47us) server_negotiation.cc:407] Connection header received
0806 15:08:21.573217 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:21.573218 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:21.573229 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:21.573272 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:21.573574 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.574080 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.574796 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:21.574987 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:21.575045 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:21.577398 (+ 2353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:57485: BlockingRecv error: recv got EOF from 127.29.69.131:57485 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
Aug 06 15:08:22 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:22 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:22.325382 6995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:22.320562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:45409)
0806 15:08:22.320725 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:22.320736 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:22.320790 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:22.320937 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:22.320938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:22.321104 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:22.321158 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:22.321159 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.321854 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.321855 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:22.322538 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:22.322540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.322991 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.322992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:22.323035 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:22.323468 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:22.323472 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:22.325267 (+ 1795us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":99,"threads_started":1}
W20260806 15:08:22.325438 6996 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:22.320667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:45409 (local address 127.29.69.190:42785)
0806 15:08:22.320806 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:22.320808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:22.320831 (+ 23us) server_negotiation.cc:407] Connection header received
0806 15:08:22.320855 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:22.320856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:22.320867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:22.320918 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:22.321251 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.321784 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.322601 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.322911 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.322983 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:22.325363 (+ 2380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:45409: BlockingRecv error: recv got EOF from 127.29.69.129:45409 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
Aug 06 15:08:22 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:22 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:22.458635 6997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:22.453892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:51369)
0806 15:08:22.454035 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:22.454053 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:22.454110 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:22.454234 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:22.454234 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:22.454424 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:22.454477 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:22.454479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.455156 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.455156 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:22.455693 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:22.455694 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.456044 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.456045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:22.456087 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:22.456593 (+ 506us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:22.456598 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:22.458527 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
W20260806 15:08:22.458691 6996 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:22.453977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:51369 (local address 127.29.69.190:42785)
0806 15:08:22.454032 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:22.454034 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:22.454094 (+ 60us) server_negotiation.cc:407] Connection header received
0806 15:08:22.454153 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:22.454154 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:22.454164 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:22.454218 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:22.454563 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.455087 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.455775 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.455975 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.456035 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:22.458624 (+ 2589us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:51369: BlockingRecv error: recv got EOF from 127.29.69.130:51369 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 06 15:08:22 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:22 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:22.582762 6998 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:22.577844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:53263)
0806 15:08:22.578040 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:22.578053 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:22.578125 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:22.578278 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:22.578279 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:22.578472 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:22.578531 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:22.578533 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.579218 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.579219 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:22.579762 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:22.579763 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.580164 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.580165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:22.580233 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:22.580733 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:22.580741 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:22.582699 (+ 1958us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":108,"threads_started":1}
W20260806 15:08:22.582897 6996 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:22.577953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:53263 (local address 127.29.69.190:42785)
0806 15:08:22.578037 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:22.578039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:22.578104 (+ 65us) server_negotiation.cc:407] Connection header received
0806 15:08:22.578182 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:22.578183 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:22.578197 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:22.578270 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:22.578613 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.579125 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.579884 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:22.580076 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:22.580150 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:22.582815 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:53263: BlockingRecv error: recv got EOF from 127.29.69.131:53263 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 06 15:08:23 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:23 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:23.330593 6999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:23.325971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:48003)
0806 15:08:23.326133 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:23.326146 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:23.326203 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:23.326366 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:23.326367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:23.326541 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:23.326603 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:23.326605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.327311 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.327312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:23.327847 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:23.327848 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.328174 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.328175 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:23.328217 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:23.328671 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:23.328675 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:23.330526 (+ 1851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
W20260806 15:08:23.330758 7000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:23.326093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:48003 (local address 127.29.69.190:42785)
0806 15:08:23.326228 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:23.326230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:23.326238 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:23.326264 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:23.326265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:23.326278 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:23.326357 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:23.326712 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.327240 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.327919 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.328109 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.328162 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:23.330658 (+ 2496us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:48003: BlockingRecv error: recv got EOF from 127.29.69.129:48003 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
Aug 06 15:08:23 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:23 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:23.463869 7001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:23.459199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:33151)
0806 15:08:23.459331 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:23.459341 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:23.459396 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:23.459527 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:23.459527 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:23.459690 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:23.459743 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:23.459744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.460535 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.460535 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:23.461052 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:23.461053 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.461418 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.461419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:23.461505 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:23.462014 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:23.462018 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:23.463811 (+ 1793us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":78,"threads_started":1}
W20260806 15:08:23.464000 7000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:23.459269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:33151 (local address 127.29.69.190:42785)
0806 15:08:23.459321 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:23.459323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:23.459380 (+ 57us) server_negotiation.cc:407] Connection header received
0806 15:08:23.459440 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:23.459441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:23.459458 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:23.459509 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:23.459804 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.460470 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.461136 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.461353 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.461415 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:23.463919 (+ 2504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:33151: BlockingRecv error: recv got EOF from 127.29.69.130:33151 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Aug 06 15:08:23 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:23 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:23.588020 7003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:23.583224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:43737)
0806 15:08:23.583393 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:23.583405 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:23.583496 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:23.583646 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:23.583648 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:23.583829 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:23.583879 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:23.583881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.584816 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.584817 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:23.585371 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:23.585373 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.585754 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.585755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:23.585818 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:23.586243 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:23.586248 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:23.587929 (+ 1681us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":105,"threads_started":1}
W20260806 15:08:23.588088 7000 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:23.583286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:43737 (local address 127.29.69.190:42785)
0806 15:08:23.583349 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:23.583352 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:23.583476 (+ 124us) server_negotiation.cc:407] Connection header received
0806 15:08:23.583551 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:23.583552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:23.583567 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:23.583639 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:23.583982 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.584735 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.585467 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:23.585681 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:23.585756 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:23.588022 (+ 2266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:43737: BlockingRecv error: recv got EOF from 127.29.69.131:43737 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 06 15:08:24 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:24 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:24.335412 7004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:24.331012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:46403)
0806 15:08:24.331181 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:24.331192 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:24.331254 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:24.331368 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:24.331368 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:24.331530 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:24.331581 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:24.331582 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.332227 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.332228 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:24.332735 (+ 507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:24.332736 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.333060 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.333061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:24.333102 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:24.333535 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:24.333539 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:24.335351 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
W20260806 15:08:24.335522 7005 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:24.331096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:46403 (local address 127.29.69.190:42785)
0806 15:08:24.331197 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:24.331199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:24.331255 (+ 56us) server_negotiation.cc:407] Connection header received
0806 15:08:24.331297 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:24.331297 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:24.331307 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:24.331364 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:24.331638 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.332149 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.332797 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.333001 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.333048 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:24.335443 (+ 2395us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:46403: BlockingRecv error: recv got EOF from 127.29.69.129:46403 (error 108)
Metrics: {"server-negotiator.queue_time_us":79,"thread_start_us":51,"threads_started":1}
Aug 06 15:08:24 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:24 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:24.473457 7006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:24.464319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:56327)
0806 15:08:24.464515 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:24.464525 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:24.464581 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:24.464708 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:24.464709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:24.464895 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:24.464950 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:24.464952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.465584 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.465584 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:24.466116 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:24.466117 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.466485 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.466486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:24.466529 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:24.471247 (+ 4718us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:24.471252 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:24.473392 (+ 2140us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":124,"threads_started":1}
W20260806 15:08:24.473610 7005 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:24.464390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:56327 (local address 127.29.69.190:42785)
0806 15:08:24.464460 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:24.464462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:24.464583 (+ 121us) server_negotiation.cc:407] Connection header received
0806 15:08:24.464638 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:24.464639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:24.464649 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:24.464690 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:24.465013 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.465521 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.466183 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.466426 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.466477 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:24.473515 (+ 7038us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:56327: BlockingRecv error: recv got EOF from 127.29.69.130:56327 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 06 15:08:24 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:24 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:24.593387 7007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:24.588599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:48889)
0806 15:08:24.588789 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:24.588820 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:24.588898 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:24.589039 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:24.589040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:24.589219 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:24.589297 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:24.589299 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.589959 (+ 660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.589961 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:24.590552 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:24.590553 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.590938 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.590938 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:24.591000 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:24.591419 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:24.591423 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:24.593318 (+ 1895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":108,"threads_started":1}
W20260806 15:08:24.593464 7005 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:24.588695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:48889 (local address 127.29.69.190:42785)
0806 15:08:24.588810 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:24.588812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:24.588872 (+ 60us) server_negotiation.cc:407] Connection header received
0806 15:08:24.588952 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:24.588953 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:24.588967 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:24.589031 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:24.589366 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.589876 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.590641 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:24.590852 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:24.590936 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:24.593417 (+ 2481us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:48889: BlockingRecv error: recv got EOF from 127.29.69.131:48889 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 06 15:08:25 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:25 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:25.340523 7008 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:25.335907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:38179)
0806 15:08:25.336046 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:25.336062 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:25.336117 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:25.336242 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:25.336242 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:25.336404 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:25.336458 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:25.336459 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.337098 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.337099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:25.337632 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:25.337633 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.337965 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.337966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:25.338006 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:25.338570 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:25.338575 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:25.340397 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
W20260806 15:08:25.340592 7011 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:25.335999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:38179 (local address 127.29.69.190:42785)
0806 15:08:25.336128 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:25.336130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:25.336137 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:25.336161 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:25.336161 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:25.336170 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:25.336227 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:25.336522 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.337032 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.337701 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.337889 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.337936 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:25.340515 (+ 2579us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:38179: BlockingRecv error: recv got EOF from 127.29.69.129:38179 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":56,"threads_started":1}
Aug 06 15:08:25 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:25 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:25.478673 7012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:25.473960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:59011)
0806 15:08:25.474122 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:25.474133 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:25.474194 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:25.474350 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:25.474351 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:25.474525 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:25.474579 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:25.474581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.475290 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.475291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:25.475837 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:25.475838 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.476196 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.476196 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:25.476238 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:25.476747 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:25.476752 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:25.478605 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":70,"threads_started":1}
W20260806 15:08:25.478802 7011 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:25.474072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:59011 (local address 127.29.69.190:42785)
0806 15:08:25.474121 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:25.474124 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:25.474197 (+ 73us) server_negotiation.cc:407] Connection header received
0806 15:08:25.474239 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:25.474239 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:25.474251 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:25.474295 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:25.474673 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.475215 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.475922 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.476127 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.476187 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:25.478699 (+ 2512us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:59011: BlockingRecv error: recv got EOF from 127.29.69.130:59011 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 06 15:08:25 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:25 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:25.598780 7013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:25.593895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:45875)
0806 15:08:25.594074 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:25.594087 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:25.594159 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:25.594365 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:25.594366 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:25.594543 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:25.594601 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:25.594603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.595290 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.595291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:25.595841 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:25.595842 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.596213 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.596214 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:25.596280 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:25.596719 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:25.596723 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:25.598685 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":86,"threads_started":1}
W20260806 15:08:25.598819 7011 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:25.594025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:45875 (local address 127.29.69.190:42785)
0806 15:08:25.594106 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:25.594108 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:25.594145 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:08:25.594240 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:25.594241 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:25.594254 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:25.594351 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:25.594684 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.595204 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.595924 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:25.596138 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:25.596214 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:25.598759 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:45875: BlockingRecv error: recv got EOF from 127.29.69.131:45875 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
Aug 06 15:08:26 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:26 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:26.345860 7014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:26.341121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:47403)
0806 15:08:26.341250 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:26.341260 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:26.341306 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:26.341434 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:26.341435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:26.341605 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:26.341657 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:26.341659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.342363 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.342366 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:26.343151 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:26.343154 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.343477 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.343478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:26.343526 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:26.344004 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:26.344009 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:26.345786 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":71,"threads_started":1}
W20260806 15:08:26.345979 7015 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:26.341178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:47403 (local address 127.29.69.190:42785)
0806 15:08:26.341312 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:26.341314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:26.341323 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:08:26.341346 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:26.341346 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:26.341357 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:26.341418 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:26.341733 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.342255 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.343225 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.343415 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.343470 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:26.345876 (+ 2406us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:47403: BlockingRecv error: recv got EOF from 127.29.69.129:47403 (error 108)
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":71,"threads_started":1}
Aug 06 15:08:26 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:26 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:26.484107 7016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:26.479156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:58383)
0806 15:08:26.479315 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:26.479325 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:26.479401 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:26.479560 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:26.479561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:26.479753 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:26.479805 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:26.479807 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.480522 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.480523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:26.481067 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:26.481069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.481445 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.481446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:26.481514 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:26.482059 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:26.482063 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:26.483998 (+ 1935us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":96,"threads_started":1}
W20260806 15:08:26.484148 7015 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:26.479352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:58383 (local address 127.29.69.190:42785)
0806 15:08:26.479428 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:26.479430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:26.479440 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:08:26.479468 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:26.479469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:26.479480 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:26.479552 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:26.479899 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.480438 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.481157 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.481373 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.481446 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:26.484081 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:58383: BlockingRecv error: recv got EOF from 127.29.69.130:58383 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Aug 06 15:08:26 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:26 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:26.604104 7017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:26.599270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:44517)
0806 15:08:26.599455 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:26.599466 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:26.599551 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:26.599685 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:26.599686 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:26.599874 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:26.599925 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:26.599927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.600580 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.600581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:26.601159 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:26.601161 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.601558 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.601558 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:26.601630 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:26.602071 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:26.602076 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:26.603992 (+ 1916us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":155,"thread_start_us":76,"threads_started":1}
W20260806 15:08:26.604144 7015 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:26.599382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:44517 (local address 127.29.69.190:42785)
0806 15:08:26.599454 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:26.599457 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:26.599534 (+ 77us) server_negotiation.cc:407] Connection header received
0806 15:08:26.599606 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:26.599607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:26.599620 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:26.599662 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:26.599987 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.600488 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.601282 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:26.601483 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:26.601558 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:26.604078 (+ 2520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:44517: BlockingRecv error: recv got EOF from 127.29.69.131:44517 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 06 15:08:27 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:27 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:27.351025 7018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:27.346292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:60895)
0806 15:08:27.346489 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:27.346501 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:27.346572 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:27.346705 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:27.346706 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:27.346878 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:27.346930 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:27.346932 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.347599 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.347600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:27.348145 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:27.348147 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.348492 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.348493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:27.348536 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:27.348991 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:27.348995 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:27.350926 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":71,"threads_started":1}
W20260806 15:08:27.351092 7019 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:27.346391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:60895 (local address 127.29.69.190:42785)
0806 15:08:27.346520 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:27.346522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:27.346569 (+ 47us) server_negotiation.cc:407] Connection header received
0806 15:08:27.346624 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:27.346624 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:27.346634 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:27.346683 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:27.346994 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.347512 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.348227 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.348424 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.348477 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:27.351007 (+ 2530us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:60895: BlockingRecv error: recv got EOF from 127.29.69.129:60895 (error 108)
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":77,"threads_started":1}
Aug 06 15:08:27 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:27 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:27.489269 7020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:27.484538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:45407)
0806 15:08:27.484730 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:27.484741 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:27.484829 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:27.484992 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:27.484993 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:27.485182 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:27.485231 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:27.485233 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.485936 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.485937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:27.486499 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:27.486500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.486885 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.486886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:27.486954 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:27.487456 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:27.487461 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:27.489172 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":83,"threads_started":1}
W20260806 15:08:27.489316 7019 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:27.484636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:45407 (local address 127.29.69.190:42785)
0806 15:08:27.484722 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:27.484724 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:27.484813 (+ 89us) server_negotiation.cc:407] Connection header received
0806 15:08:27.484917 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:27.484918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:27.484930 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:27.484976 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:27.485311 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.485843 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.486588 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.486795 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.486882 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:27.489251 (+ 2369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:45407: BlockingRecv error: recv got EOF from 127.29.69.130:45407 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 06 15:08:27 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:27 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:27.609290 7021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:27.604615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:47137)
0806 15:08:27.604753 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:27.604765 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:27.604828 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:27.604967 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:27.604968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:27.605132 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:27.605184 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:27.605186 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.605996 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.605998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:27.606617 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:27.606619 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.606927 (+ 308us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.606928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:27.606974 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:27.607404 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:27.607409 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:27.609170 (+ 1761us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
W20260806 15:08:27.609316 7019 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:27.604714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:47137 (local address 127.29.69.190:42785)
0806 15:08:27.604779 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:27.604781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:27.604826 (+ 45us) server_negotiation.cc:407] Connection header received
0806 15:08:27.604872 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:27.604872 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:27.604892 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:27.604948 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:27.605245 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.605917 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.606686 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:27.606863 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:27.606912 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:27.609249 (+ 2337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:47137: BlockingRecv error: recv got EOF from 127.29.69.131:47137 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 06 15:08:28 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:28 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:28.356588 7022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:28.351520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:58457)
0806 15:08:28.351706 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:28.351717 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:28.351780 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:28.352091 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:28.352093 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:28.352268 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:28.352322 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:28.352323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.353083 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.353084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:28.353646 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:28.353647 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.354009 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.354009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:28.354058 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:28.354554 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:28.354558 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:28.356473 (+ 1915us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":117,"threads_started":1}
W20260806 15:08:28.356637 7023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:28.351614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:58457 (local address 127.29.69.190:42785)
0806 15:08:28.351728 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:28.351730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:28.351914 (+ 184us) server_negotiation.cc:407] Connection header received
0806 15:08:28.351950 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:28.351951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:28.351967 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:28.352080 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:28.352437 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.352984 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.353729 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.353939 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.353999 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:28.356556 (+ 2557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:58457: BlockingRecv error: recv got EOF from 127.29.69.129:58457 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":52,"threads_started":1}
Aug 06 15:08:28 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:28 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:28.494544 7024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:28.489760 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:53309)
0806 15:08:28.489933 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:28.489947 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:28.490010 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:28.490163 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:28.490164 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:28.490373 (+ 209us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:28.490428 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:28.490430 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.491085 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.491085 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:28.491619 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:28.491620 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.491955 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.491956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:28.491996 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:28.492494 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:28.492499 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:28.494472 (+ 1973us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":112,"threads_started":1}
W20260806 15:08:28.494669 7023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:28.489888 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:53309 (local address 127.29.69.190:42785)
0806 15:08:28.489958 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:28.489959 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:28.489995 (+ 36us) server_negotiation.cc:407] Connection header received
0806 15:08:28.490070 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:28.490071 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:28.490087 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:28.490129 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:28.490500 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.491014 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.491694 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.491880 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.491941 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:28.494569 (+ 2628us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:53309: BlockingRecv error: recv got EOF from 127.29.69.130:53309 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Aug 06 15:08:28 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:28 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:28.614655 7025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:28.609821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:49619)
0806 15:08:28.610047 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:28.610059 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:28.610120 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:28.610252 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:28.610253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:28.610482 (+ 229us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:28.610535 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:28.610537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.611206 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.611207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:28.611763 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:28.611765 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.612146 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.612147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:28.612208 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:28.612645 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:28.612650 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:28.614553 (+ 1903us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":154,"threads_started":1}
W20260806 15:08:28.614741 7023 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:28.609890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:49619 (local address 127.29.69.190:42785)
0806 15:08:28.609966 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:28.609969 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:28.610121 (+ 152us) server_negotiation.cc:407] Connection header received
0806 15:08:28.610176 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:28.610177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:28.610189 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:28.610230 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:28.610602 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.611114 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.611853 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:28.612042 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:28.612099 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:28.614643 (+ 2544us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:49619: BlockingRecv error: recv got EOF from 127.29.69.131:49619 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 06 15:08:29 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:29 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:29.362032 7026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:29.357228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:59899)
0806 15:08:29.357386 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:29.357404 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:29.357459 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:29.357596 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:29.357597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:29.357787 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:29.357839 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:29.357841 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.358531 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.358532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:29.359134 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:29.359136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.359592 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.359593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:29.359659 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:29.360089 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:29.360093 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:29.361933 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":98,"threads_started":1}
W20260806 15:08:29.362088 7027 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:29.357327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:59899 (local address 127.29.69.190:42785)
0806 15:08:29.357470 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:29.357474 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:29.357497 (+ 23us) server_negotiation.cc:407] Connection header received
0806 15:08:29.357518 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:29.357518 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:29.357528 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:29.357577 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:29.357909 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.358465 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.359219 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.359488 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.359589 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:29.362012 (+ 2423us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:59899: BlockingRecv error: recv got EOF from 127.29.69.129:59899 (error 108)
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":54,"threads_started":1}
Aug 06 15:08:29 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:29 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.130@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:29.543529 7028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:29.495124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.130:54397)
0806 15:08:29.495268 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:29.495278 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:29.495337 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:29.495468 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:29.495469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:29.495639 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:29.495692 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:29.495694 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.496336 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.496337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:29.496859 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:29.496860 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.497176 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.497177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:29.497218 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:29.541483 (+ 44265us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:29.541490 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:29.543437 (+ 1947us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":95,"threads_started":1}
W20260806 15:08:29.543603 7027 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:29.495179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:54397 (local address 127.29.69.190:42785)
0806 15:08:29.495249 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:29.495251 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:29.495340 (+ 89us) server_negotiation.cc:407] Connection header received
0806 15:08:29.495384 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:29.495384 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:29.495396 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:29.495445 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:29.495753 (+ 308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.496274 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.496927 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.497115 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.497164 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:29.543540 (+ 46376us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.130:54397: BlockingRecv error: recv got EOF from 127.29.69.130:54397 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 06 15:08:29 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:29 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.131@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:29.619648 7029 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:29.615140 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.131:35635)
0806 15:08:29.615300 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:29.615310 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:29.615371 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:29.615517 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:29.615518 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:29.615688 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:29.615739 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:29.615741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.616399 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.616400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:29.616961 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:29.616962 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.617297 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.617298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:29.617337 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:29.617746 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:29.617750 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:29.619548 (+ 1798us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
W20260806 15:08:29.619683 7027 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:29.615217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:35635 (local address 127.29.69.190:42785)
0806 15:08:29.615290 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:29.615293 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:29.615373 (+ 80us) server_negotiation.cc:407] Connection header received
0806 15:08:29.615435 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:29.615436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:29.615449 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:29.615492 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:29.615803 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.616309 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.617048 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:29.617232 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:29.617286 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:29.619623 (+ 2337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.131:35635: BlockingRecv error: recv got EOF from 127.29.69.131:35635 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 06 15:08:30 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
Aug 06 15:08:30 dist-test-slave-tm1g krb5kdc[5946](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.29.69.129@KRBTEST.COM for oryx/127.29.69.190@KRBTEST.COM, Server not found in Kerberos database
I20260806 15:08:30.367113 7030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:30.362604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42785 (local address 127.29.69.129:36041)
0806 15:08:30.362789 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:30.362802 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:30.362862 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:30.363036 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:30.363037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:30.363209 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:30.363265 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:30.363267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.363945 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.363946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:30.364493 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:30.364495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.364831 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.364832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:30.364874 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:30.365316 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:30.365320 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:30.367046 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.29.69.190:42785: Server oryx/127.29.69.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":89,"threads_started":1}
W20260806 15:08:30.367242 7031 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:30.362669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:36041 (local address 127.29.69.190:42785)
0806 15:08:30.362825 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:30.362828 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:30.362865 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:08:30.362942 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:30.362942 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:30.362953 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:30.363021 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:30.363327 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.363874 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.364567 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.364766 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.364820 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:30.367135 (+ 2315us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.29.69.129:36041: BlockingRecv error: recv got EOF from 127.29.69.129:36041 (error 108)
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":99,"threads_started":1}
I20260806 15:08:30.531510 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6544
I20260806 15:08:30.537019 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6699
I20260806 15:08:30.541543 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6834
I20260806 15:08:30.546396 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 6472
2026-08-06T15:08:30Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17428 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-06T15:08:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:30Z Disabled control of system clock
I20260806 15:08:30.574258 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:44141
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:39681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:44141
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260806 15:08:30.654565 7035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:30.654752 7035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:30.654771 7035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:30.655871 7035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:30.655903 7035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:30.655916 7035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:30.655928 7035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:30.655941 7035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:30.657200 7035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:44141
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:44141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7035
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:30.657378 7035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:30.657604 7035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:30.662670 7041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:30.662741 7042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:30.662803 7044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:30.662966 7035 server_base.cc:1034] running on GCE node
I20260806 15:08:30.663178 7035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:30.663478 7035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:30.664633 7035 hybrid_clock.cc:648] HybridClock initialized: now 1786028910664628 us; error 35 us; skew 500 ppm
I20260806 15:08:30.665830 7035 webserver.cc:460] Webserver started at http://127.29.69.190:34675/ using document root <none> and password file <none>
I20260806 15:08:30.666081 7035 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:30.666152 7035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:30.666343 7035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:30.667361 7035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "0508718bef3944c59d2a64ca02fa7c52"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "21703cf1f8eaf5ede688618bb8967c0f"
server_key_iv: "20f192c2540225125fb6ac1ed5c5be05"
server_key_version: "encryptionkey@0"
I20260806 15:08:30.667742 7035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "0508718bef3944c59d2a64ca02fa7c52"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "21703cf1f8eaf5ede688618bb8967c0f"
server_key_iv: "20f192c2540225125fb6ac1ed5c5be05"
server_key_version: "encryptionkey@0"
I20260806 15:08:30.669075 7035 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:30.669878 7050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:30.670066 7035 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:30.670157 7035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "0508718bef3944c59d2a64ca02fa7c52"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "21703cf1f8eaf5ede688618bb8967c0f"
server_key_iv: "20f192c2540225125fb6ac1ed5c5be05"
server_key_version: "encryptionkey@0"
I20260806 15:08:30.670243 7035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:30.713135 7035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:30.713475 7035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:30.713634 7035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:30.717749 7035 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:44141
I20260806 15:08:30.717785 7102 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:44141 every 8 connection(s)
I20260806 15:08:30.718148 7035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:30.718633 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7035
I20260806 15:08:30.718734 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:30.718926 29974 external_mini_cluster.cc:1428] Setting key 0b5a16dbd2c0dfc7cca24ba192bc5625
I20260806 15:08:30.719024 7104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:30.722584 7104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52: Bootstrap starting.
I20260806 15:08:30.723300 7104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:30.723637 7104 log.cc:824] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:30.724463 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:30.719500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54020 (local address 127.29.69.190:44141)
0806 15:08:30.719700 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:30.719714 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:30.719739 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:08:30.720163 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:30.720169 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:30.720224 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:30.720334 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:30.720559 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.721408 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.722499 (+ 1091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.722944 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.723032 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:30.723770 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:30.723774 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:30.723774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:30.723955 (+ 181us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:30.723987 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:30.723998 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:30.724051 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:30.724170 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 15:08:30.724248 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":97,"threads_started":1}
I20260806 15:08:30.724472 7104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52: No bootstrap required, opened a new log
I20260806 15:08:30.726495 7104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0508718bef3944c59d2a64ca02fa7c52" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44141 } }
I20260806 15:08:30.726673 7104 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:30.726702 7104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0508718bef3944c59d2a64ca02fa7c52, State: Initialized, Role: FOLLOWER
I20260806 15:08:30.726815 7104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0508718bef3944c59d2a64ca02fa7c52" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44141 } }
I20260806 15:08:30.726909 7104 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:30.726933 7104 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:30.726966 7104 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:30.727471 7104 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0508718bef3944c59d2a64ca02fa7c52" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44141 } }
I20260806 15:08:30.727556 7104 leader_election.cc:302] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0508718bef3944c59d2a64ca02fa7c52; no voters:
I20260806 15:08:30.727679 7104 leader_election.cc:288] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:30.727753 7109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:30.727908 7109 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [term 1 LEADER]: Becoming Leader. State: Replica: 0508718bef3944c59d2a64ca02fa7c52, State: Running, Role: LEADER
I20260806 15:08:30.727945 7104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:30.727998 7109 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0508718bef3944c59d2a64ca02fa7c52" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44141 } }
I20260806 15:08:30.728344 7109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0508718bef3944c59d2a64ca02fa7c52. Latest consensus state: current_term: 1 leader_uuid: "0508718bef3944c59d2a64ca02fa7c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0508718bef3944c59d2a64ca02fa7c52" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44141 } } }
I20260806 15:08:30.728493 7109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:30.728374 7111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0508718bef3944c59d2a64ca02fa7c52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0508718bef3944c59d2a64ca02fa7c52" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44141 } } }
I20260806 15:08:30.728730 7111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:30.728935 7117 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:30.729403 7117 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:30.730916 7117 catalog_manager.cc:1347] Generated new cluster ID: 01758504d57644f989924e8aa10042d0
I20260806 15:08:30.730973 7117 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:30.749609 7117 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:30.750329 7117 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:30.764420 7117 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0508718bef3944c59d2a64ca02fa7c52: Generated new TSK 0
I20260806 15:08:30.764650 7117 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:08:30.770232 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44141
--builtin_ntp_servers=127.29.69.148:39681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 15:08:30.863909 7129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:30.864100 7129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:30.864121 7129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:30.865243 7129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:30.865283 7129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:30.865307 7129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:30.866734 7129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:30.866981 7129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:30.867286 7129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:30.873023 7137 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:30.873028 7134 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:30.873034 7135 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:30.873781 7129 server_base.cc:1034] running on GCE node
I20260806 15:08:30.873977 7129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:30.874231 7129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:30.875470 7129 hybrid_clock.cc:648] HybridClock initialized: now 1786028910875464 us; error 42 us; skew 500 ppm
I20260806 15:08:30.876842 7129 webserver.cc:460] Webserver started at http://127.29.69.129:38795/ using document root <none> and password file <none>
I20260806 15:08:30.877113 7129 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:30.877183 7129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:30.877344 7129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:30.878526 7129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "8dc8fd40e10d4befb78102c55b223d26"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "caa0f7a585f66e9ac0bb53546046f332"
server_key_iv: "b121379df19a37320150ea8e9edceaa3"
server_key_version: "encryptionkey@0"
I20260806 15:08:30.878890 7129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "8dc8fd40e10d4befb78102c55b223d26"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "caa0f7a585f66e9ac0bb53546046f332"
server_key_iv: "b121379df19a37320150ea8e9edceaa3"
server_key_version: "encryptionkey@0"
I20260806 15:08:30.880219 7129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:30.881024 7144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:30.881232 7129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:30.881342 7129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "8dc8fd40e10d4befb78102c55b223d26"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "caa0f7a585f66e9ac0bb53546046f332"
server_key_iv: "b121379df19a37320150ea8e9edceaa3"
server_key_version: "encryptionkey@0"
I20260806 15:08:30.881424 7129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:30.889216 7129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:30.889506 7129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:30.889655 7129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:30.889864 7129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:30.890201 7129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:30.890259 7129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:30.890331 7129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:30.890391 7129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:30.895949 7129 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:35343
I20260806 15:08:30.896004 7258 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:35343 every 8 connection(s)
I20260806 15:08:30.896466 7129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:30.901618 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:30.897276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:48543 (local address 127.29.69.190:44141)
0806 15:08:30.897342 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:30.897349 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:30.897600 (+ 251us) server_negotiation.cc:407] Connection header received
0806 15:08:30.898084 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:30.898085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:30.898097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:30.898158 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:30.898852 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.899349 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.900304 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.900489 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.900550 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:30.901398 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:30.901399 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:30.901399 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:30.901403 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:30.901415 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:30.901419 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:30.901460 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:30.901526 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 15:08:30.901559 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 15:08:30.901773 7261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:30.897267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44141 (local address 127.29.69.129:48543)
0806 15:08:30.897473 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:30.897513 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:30.898006 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:30.898210 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:30.898213 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:30.898221 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:30.898765 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:30.898770 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.899437 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.899438 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:30.900229 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:30.900231 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:30.900580 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:30.900581 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:30.900693 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:30.901273 (+ 580us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:08:30.901274 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:30.901302 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:08:30.901324 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:30.901462 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:30.901464 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:30.901466 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:08:30.901512 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 15:08:30.901586 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":99,"threads_started":1}
I20260806 15:08:30.902297 7259 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44141
I20260806 15:08:30.902410 7259 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:30.902568 7259 heartbeater.cc:511] Master 127.29.69.190:44141 requested a full tablet report, sending...
I20260806 15:08:30.903069 7067 ts_manager.cc:194] Registered new tserver with Master: 8dc8fd40e10d4befb78102c55b223d26 (127.29.69.129:35343)
I20260806 15:08:30.903627 7067 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.129:48543
I20260806 15:08:30.905946 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7129
I20260806 15:08:30.906016 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:30.906157 29974 external_mini_cluster.cc:1428] Setting key e08add8fafdc44b0ea91797e4a6cd918
I20260806 15:08:30.907028 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44141
--builtin_ntp_servers=127.29.69.148:39681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 15:08:30.987157 7262 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:30.987382 7262 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:30.987417 7262 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:30.988547 7262 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:30.988610 7262 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:30.988648 7262 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:30.989974 7262 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:30.990237 7262 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:30.990579 7262 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:30.995545 7267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:30.995592 7262 server_base.cc:1034] running on GCE node
W20260806 15:08:30.995558 7268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:30.995563 7270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:30.995959 7262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:30.996205 7262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:30.997359 7262 hybrid_clock.cc:648] HybridClock initialized: now 1786028910997343 us; error 28 us; skew 500 ppm
I20260806 15:08:30.998672 7262 webserver.cc:460] Webserver started at http://127.29.69.130:35043/ using document root <none> and password file <none>
I20260806 15:08:30.998929 7262 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:30.998978 7262 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:30.999145 7262 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:31.000191 7262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "7dc1b78026fa46e3a273faaf134a9332"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "18af7cf8bbd7cfdaf87c7173e8d18ca4"
server_key_iv: "4161525b633c1f84109dd413ca9eee0d"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.000559 7262 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "7dc1b78026fa46e3a273faaf134a9332"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "18af7cf8bbd7cfdaf87c7173e8d18ca4"
server_key_iv: "4161525b633c1f84109dd413ca9eee0d"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.001986 7262 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:31.002815 7277 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.003006 7262 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.003099 7262 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "7dc1b78026fa46e3a273faaf134a9332"
format_stamp: "Formatted at 2026-08-06 15:08:30 on dist-test-slave-tm1g"
server_key: "18af7cf8bbd7cfdaf87c7173e8d18ca4"
server_key_iv: "4161525b633c1f84109dd413ca9eee0d"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.003176 7262 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:31.027244 7262 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:31.027632 7262 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:31.027805 7262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:31.028059 7262 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:31.028411 7262 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:31.028453 7262 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.028477 7262 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:31.028491 7262 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.034689 7262 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:42979
I20260806 15:08:31.034749 7392 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:42979 every 8 connection(s)
I20260806 15:08:31.035104 7262 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:31.040525 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.035862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:53523 (local address 127.29.69.190:44141)
0806 15:08:31.035933 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.035936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.036198 (+ 262us) server_negotiation.cc:407] Connection header received
0806 15:08:31.036735 (+ 537us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.036737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.036750 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.036804 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.037486 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.038022 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.039031 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.039247 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.039325 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:31.040210 (+ 885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:31.040211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:31.040211 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:31.040217 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:31.040233 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:31.040240 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:31.040307 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:31.040406 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 15:08:31.040435 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 15:08:31.040733 7395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.035860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44141 (local address 127.29.69.130:53523)
0806 15:08:31.036071 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:31.036104 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:31.036625 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:31.036877 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:31.036880 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:31.036888 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:31.037370 (+ 482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:31.037375 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.038123 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.038124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:31.038927 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:31.038929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.039335 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.039336 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:31.039472 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:31.040066 (+ 594us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:08:31.040066 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:31.040094 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:08:31.040116 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:31.040308 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:31.040315 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:31.040318 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:31.040407 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 15:08:31.040509 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":82,"threads_started":1}
I20260806 15:08:31.041239 7393 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44141
I20260806 15:08:31.041316 7393 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:31.041512 7393 heartbeater.cc:511] Master 127.29.69.190:44141 requested a full tablet report, sending...
I20260806 15:08:31.041592 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7262
I20260806 15:08:31.041690 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:31.041896 29974 external_mini_cluster.cc:1428] Setting key 328556d291fde5f0d2565b59c2fba68e
I20260806 15:08:31.041929 7067 ts_manager.cc:194] Registered new tserver with Master: 7dc1b78026fa46e3a273faaf134a9332 (127.29.69.130:42979)
I20260806 15:08:31.042459 7067 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.130:53523
I20260806 15:08:31.042936 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44141
--builtin_ntp_servers=127.29.69.148:39681
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260806 15:08:31.123180 7396 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:31.123404 7396 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:31.123438 7396 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:31.124574 7396 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:31.124637 7396 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:31.124678 7396 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:31.126021 7396 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39681
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44141
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7396
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:31.126281 7396 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:31.126596 7396 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:31.131680 7402 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.131675 7401 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.131743 7404 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.131794 7396 server_base.cc:1034] running on GCE node
I20260806 15:08:31.132128 7396 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:31.132349 7396 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:31.133505 7396 hybrid_clock.cc:648] HybridClock initialized: now 1786028911133500 us; error 34 us; skew 500 ppm
I20260806 15:08:31.134866 7396 webserver.cc:460] Webserver started at http://127.29.69.131:40257/ using document root <none> and password file <none>
I20260806 15:08:31.135113 7396 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:31.135180 7396 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:31.135329 7396 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:31.136339 7396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "18f5e7ff0c844fda9db3491d6e6a00b8"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "3122709a99d4f9af135094dce461c621"
server_key_iv: "60e3c5d09aaed24e6ea37304be3c5900"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.136693 7396 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "18f5e7ff0c844fda9db3491d6e6a00b8"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "3122709a99d4f9af135094dce461c621"
server_key_iv: "60e3c5d09aaed24e6ea37304be3c5900"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.137992 7396 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:08:31.138799 7410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.138967 7396 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.139060 7396 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "18f5e7ff0c844fda9db3491d6e6a00b8"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "3122709a99d4f9af135094dce461c621"
server_key_iv: "60e3c5d09aaed24e6ea37304be3c5900"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.139137 7396 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:31.155023 7396 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:31.155285 7396 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:31.155426 7396 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:31.155642 7396 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:31.155944 7396 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:31.155998 7396 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.156032 7396 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:31.156059 7396 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.161520 7396 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:37281
I20260806 15:08:31.161600 7526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:37281 every 8 connection(s)
I20260806 15:08:31.161882 7396 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:31.166712 7107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.162613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:38733 (local address 127.29.69.190:44141)
0806 15:08:31.162664 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.162666 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.162858 (+ 192us) server_negotiation.cc:407] Connection header received
0806 15:08:31.163329 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.163330 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.163364 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.163429 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.164029 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.164531 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.165462 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.165649 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.165706 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:31.166462 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:31.166464 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:31.166464 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:31.166468 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:31.166482 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:31.166485 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:31.166545 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:31.166633 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 15:08:31.166654 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:08:31.166916 7529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.162566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44141 (local address 127.29.69.131:38733)
0806 15:08:31.162746 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:31.162785 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:31.163234 (+ 449us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:31.163477 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:31.163480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:31.163488 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:31.163958 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:31.163962 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.164609 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.164610 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:31.165376 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:31.165379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:31.165726 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:31.165727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:31.165830 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:31.166287 (+ 457us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:08:31.166287 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:31.166333 (+ 46us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:08:31.166354 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:31.166560 (+ 206us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:31.166564 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:31.166567 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:31.166618 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 15:08:31.166693 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":85,"threads_started":1}
I20260806 15:08:31.167390 7527 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44141
I20260806 15:08:31.167492 7527 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:31.167551 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7396
I20260806 15:08:31.167636 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:31.167689 7527 heartbeater.cc:511] Master 127.29.69.190:44141 requested a full tablet report, sending...
I20260806 15:08:31.167824 29974 external_mini_cluster.cc:1428] Setting key 1b085ab0b3fed385397abef6ce4bec0b
I20260806 15:08:31.168078 7067 ts_manager.cc:194] Registered new tserver with Master: 18f5e7ff0c844fda9db3491d6e6a00b8 (127.29.69.131:37281)
I20260806 15:08:31.168524 7067 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.131:38733
I20260806 15:08:31.168689 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 15:08:31.170441 7107 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:31.169954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54034 (local address 127.29.69.190:44141)
0806 15:08:31.170012 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.170014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.170129 (+ 115us) server_negotiation.cc:407] Connection header received
0806 15:08:31.170176 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.170176 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.170184 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.170236 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.170374 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54034: BlockingRecv error: recv got EOF from 127.0.0.1:54034 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 15:08:31.170493 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7129
I20260806 15:08:31.178205 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7262
I20260806 15:08:31.183753 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7396
I20260806 15:08:31.188515 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7035
2026-08-06T15:08:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (641 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-06T15:08:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:31Z Disabled control of system clock
I20260806 15:08:31.215612 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:37537
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:37537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 15:08:31.294245 7538 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:31.294461 7538 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:31.294481 7538 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:31.295653 7538 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:31.295694 7538 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:31.295707 7538 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:31.295750 7538 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:31.295780 7538 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:31.297092 7538 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:37537
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:37537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7538
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:31.297336 7538 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:31.297633 7538 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:31.302289 7544 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.302343 7543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.302453 7538 server_base.cc:1034] running on GCE node
W20260806 15:08:31.302351 7546 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.302719 7538 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:31.303037 7538 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:31.304210 7538 hybrid_clock.cc:648] HybridClock initialized: now 1786028911304197 us; error 44 us; skew 500 ppm
I20260806 15:08:31.305413 7538 webserver.cc:460] Webserver started at http://127.29.69.190:35335/ using document root <none> and password file <none>
I20260806 15:08:31.305677 7538 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:31.305750 7538 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:31.305910 7538 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:31.306988 7538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "605eed47606b43f1919c353d5918d6f9"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "a8173d07ecea8b8d0e0852959ab99c26"
server_key_iv: "cd5ba2221c2488ca12ad58cbd2856524"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.307340 7538 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "605eed47606b43f1919c353d5918d6f9"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "a8173d07ecea8b8d0e0852959ab99c26"
server_key_iv: "cd5ba2221c2488ca12ad58cbd2856524"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.308630 7538 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:31.309427 7552 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.309602 7538 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:31.309703 7538 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "605eed47606b43f1919c353d5918d6f9"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "a8173d07ecea8b8d0e0852959ab99c26"
server_key_iv: "cd5ba2221c2488ca12ad58cbd2856524"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.309785 7538 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:31.313154 7538 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:31.313400 7538 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:31.313544 7538 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:31.317504 7538 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:37537
I20260806 15:08:31.317538 7605 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:37537 every 8 connection(s)
I20260806 15:08:31.317848 7538 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:31.318614 7606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:31.319324 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7538
I20260806 15:08:31.319419 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:31.319600 29974 external_mini_cluster.cc:1428] Setting key 823d172dc6c0a1a7242278bfb093b60c
I20260806 15:08:31.321923 7606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9: Bootstrap starting.
I20260806 15:08:31.321990 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.320114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54256 (local address 127.29.69.190:37537)
0806 15:08:31.320302 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.320309 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.320331 (+ 22us) server_negotiation.cc:407] Connection header received
0806 15:08:31.320731 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.320736 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.320770 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.320879 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.321525 (+ 646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:31.321528 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:31.321529 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:31.321532 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:31.321575 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:31.321585 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:31.321638 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:31.321732 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 15:08:31.321801 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
I20260806 15:08:31.322638 7606 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:31.322919 7606 log.cc:824] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:31.323638 7606 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9: No bootstrap required, opened a new log
I20260806 15:08:31.325022 7606 raft_consensus.cc:348] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "605eed47606b43f1919c353d5918d6f9" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37537 } }
I20260806 15:08:31.325167 7606 raft_consensus.cc:374] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:31.325217 7606 raft_consensus.cc:729] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 605eed47606b43f1919c353d5918d6f9, State: Initialized, Role: FOLLOWER
I20260806 15:08:31.325358 7606 consensus_queue.cc:260] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "605eed47606b43f1919c353d5918d6f9" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37537 } }
I20260806 15:08:31.325438 7606 raft_consensus.cc:388] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:31.325481 7606 raft_consensus.cc:482] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:31.325527 7606 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:31.326269 7606 raft_consensus.cc:504] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "605eed47606b43f1919c353d5918d6f9" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37537 } }
I20260806 15:08:31.326412 7606 leader_election.cc:302] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 605eed47606b43f1919c353d5918d6f9; no voters:
I20260806 15:08:31.326578 7606 leader_election.cc:288] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:31.326654 7611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:31.326804 7611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [term 1 LEADER]: Becoming Leader. State: Replica: 605eed47606b43f1919c353d5918d6f9, State: Running, Role: LEADER
I20260806 15:08:31.326828 7606 sys_catalog.cc:564] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:31.326911 7611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "605eed47606b43f1919c353d5918d6f9" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37537 } }
I20260806 15:08:31.327294 7613 sys_catalog.cc:455] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 605eed47606b43f1919c353d5918d6f9. Latest consensus state: current_term: 1 leader_uuid: "605eed47606b43f1919c353d5918d6f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "605eed47606b43f1919c353d5918d6f9" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37537 } } }
I20260806 15:08:31.327409 7613 sys_catalog.cc:458] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:31.327652 7620 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:31.327582 7612 sys_catalog.cc:455] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "605eed47606b43f1919c353d5918d6f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "605eed47606b43f1919c353d5918d6f9" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37537 } } }
I20260806 15:08:31.327826 7612 sys_catalog.cc:458] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:31.328249 7620 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:31.329743 7620 catalog_manager.cc:1347] Generated new cluster ID: 9c81869d0a6f4a3c90a887a99980a3d2
I20260806 15:08:31.329787 7620 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:08:31.335580 7620 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:31.335734 7620 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:31.338354 7620 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 605eed47606b43f1919c353d5918d6f9: Generated new TSK 0
I20260806 15:08:31.338526 7620 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:08:31.343873 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:37537
--builtin_ntp_servers=127.29.69.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 15:08:31.434847 7631 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:31.435040 7631 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:31.435063 7631 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:31.436203 7631 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:31.436242 7631 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:31.436267 7631 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:31.437599 7631 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:37537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7631
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:31.437815 7631 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:31.438119 7631 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:31.443984 7636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.443969 7638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.443967 7640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.444242 7631 server_base.cc:1034] running on GCE node
I20260806 15:08:31.444485 7631 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:31.444767 7631 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:31.445924 7631 hybrid_clock.cc:648] HybridClock initialized: now 1786028911445910 us; error 32 us; skew 500 ppm
I20260806 15:08:31.447243 7631 webserver.cc:460] Webserver started at http://127.29.69.129:46709/ using document root <none> and password file <none>
I20260806 15:08:31.447494 7631 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:31.447570 7631 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:31.447719 7631 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:31.448745 7631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "bed36125a6814de185d7cdc4a85f3f77"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "1b18ff222e20ab9f4e0150ca7607824a"
server_key_iv: "8347a501dff2becc9f5d4fa749841e7f"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.449132 7631 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "bed36125a6814de185d7cdc4a85f3f77"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "1b18ff222e20ab9f4e0150ca7607824a"
server_key_iv: "8347a501dff2becc9f5d4fa749841e7f"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.450474 7631 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:31.451261 7646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.451436 7631 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:31.451553 7631 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "bed36125a6814de185d7cdc4a85f3f77"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "1b18ff222e20ab9f4e0150ca7607824a"
server_key_iv: "8347a501dff2becc9f5d4fa749841e7f"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.451627 7631 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:31.454924 7631 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:31.455190 7631 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:31.455334 7631 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:31.455554 7631 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:31.455850 7631 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:31.455902 7631 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.455941 7631 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:31.455968 7631 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.461936 7631 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:40821
I20260806 15:08:31.461982 7761 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:40821 every 8 connection(s)
I20260806 15:08:31.462280 7631 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:31.465233 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.463073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:32821 (local address 127.29.69.190:37537)
0806 15:08:31.463118 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.463121 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.463390 (+ 269us) server_negotiation.cc:407] Connection header received
0806 15:08:31.463815 (+ 425us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.463815 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.463821 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.463898 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.464999 (+ 1101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:31.465000 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:31.465000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:31.465005 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:31.465023 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:31.465029 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:31.465090 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:31.465146 (+ 56us) server_negotiation.cc:299] Negotiation successful
0806 15:08:31.465160 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:08:31.465395 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.463072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:37537 (local address 127.29.69.129:32821)
0806 15:08:31.463263 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:31.463300 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:31.463731 (+ 431us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:31.463944 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:31.463948 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:31.463955 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:31.464855 (+ 900us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:08:31.464856 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:31.464882 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:08:31.464908 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:31.465091 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:31.465094 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:31.465096 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:08:31.465143 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 15:08:31.465187 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260806 15:08:31.465870 7762 heartbeater.cc:347] Connected to a master server at 127.29.69.190:37537
I20260806 15:08:31.465957 7762 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:31.466097 7762 heartbeater.cc:511] Master 127.29.69.190:37537 requested a full tablet report, sending...
I20260806 15:08:31.466574 7570 ts_manager.cc:194] Registered new tserver with Master: bed36125a6814de185d7cdc4a85f3f77 (127.29.69.129:40821)
I20260806 15:08:31.469270 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7631
I20260806 15:08:31.469362 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:31.469538 29974 external_mini_cluster.cc:1428] Setting key 3132d508040a81b5642b7ae05c2da860
I20260806 15:08:31.470486 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:37537
--builtin_ntp_servers=127.29.69.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 15:08:31.550900 7765 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:31.551141 7765 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:31.551178 7765 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:31.552363 7765 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:31.552431 7765 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:31.552474 7765 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:31.553844 7765 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:37537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7765
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:31.554158 7765 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:31.554442 7765 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:31.559355 7773 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.559360 7771 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.559386 7765 server_base.cc:1034] running on GCE node
W20260806 15:08:31.559376 7770 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.559758 7765 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:31.559993 7765 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:31.561138 7765 hybrid_clock.cc:648] HybridClock initialized: now 1786028911561126 us; error 27 us; skew 500 ppm
I20260806 15:08:31.562467 7765 webserver.cc:460] Webserver started at http://127.29.69.130:37575/ using document root <none> and password file <none>
I20260806 15:08:31.562709 7765 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:31.562757 7765 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:31.562909 7765 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:31.563977 7765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "ca66f57fcec84bfba1c737394d6ce0b6"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "d5a537a02efa999aa04389046fd72f14"
server_key_iv: "4c452c83db26a466c87e2fb566d506b4"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.564330 7765 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "ca66f57fcec84bfba1c737394d6ce0b6"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "d5a537a02efa999aa04389046fd72f14"
server_key_iv: "4c452c83db26a466c87e2fb566d506b4"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.565738 7765 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:31.566538 7779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.566743 7765 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:08:31.566861 7765 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "ca66f57fcec84bfba1c737394d6ce0b6"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "d5a537a02efa999aa04389046fd72f14"
server_key_iv: "4c452c83db26a466c87e2fb566d506b4"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.566939 7765 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:31.570278 7765 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:31.570655 7765 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:31.570788 7765 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:31.571004 7765 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:31.571322 7765 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:31.571377 7765 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.571400 7765 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:31.571413 7765 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.577000 7765 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:44879
I20260806 15:08:31.577087 7895 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:44879 every 8 connection(s)
I20260806 15:08:31.577383 7765 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:31.580272 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.578090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:43101 (local address 127.29.69.190:37537)
0806 15:08:31.578133 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.578135 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.578371 (+ 236us) server_negotiation.cc:407] Connection header received
0806 15:08:31.578851 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.578852 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.578857 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.578920 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.580087 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:31.580088 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:31.580088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:31.580091 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:31.580102 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:31.580105 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:31.580149 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:31.580206 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 15:08:31.580217 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:08:31.580489 7898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.578045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:37537 (local address 127.29.69.130:43101)
0806 15:08:31.578225 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:31.578265 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:31.578760 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:31.578992 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:31.578995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:31.579009 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:31.579952 (+ 943us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:08:31.579953 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:31.579980 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:08:31.580014 (+ 34us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:31.580158 (+ 144us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:31.580160 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:31.580163 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:08:31.580214 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 15:08:31.580260 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260806 15:08:31.580951 7896 heartbeater.cc:347] Connected to a master server at 127.29.69.190:37537
I20260806 15:08:31.581030 7896 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:31.581136 7896 heartbeater.cc:511] Master 127.29.69.190:37537 requested a full tablet report, sending...
I20260806 15:08:31.581454 7570 ts_manager.cc:194] Registered new tserver with Master: ca66f57fcec84bfba1c737394d6ce0b6 (127.29.69.130:44879)
I20260806 15:08:31.584865 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7765
I20260806 15:08:31.584945 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:31.585093 29974 external_mini_cluster.cc:1428] Setting key ff8f1d8a04d0b3b08a69a32e45fd053e
I20260806 15:08:31.586103 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:37537
--builtin_ntp_servers=127.29.69.148:41651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260806 15:08:31.667246 7899 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:31.667507 7899 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:31.667550 7899 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:31.668780 7899 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:31.668846 7899 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:31.668888 7899 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:31.670374 7899 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:37537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7899
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:31.670662 7899 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:31.670962 7899 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:31.675814 7907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.675823 7905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:31.675982 7904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:31.676107 7899 server_base.cc:1034] running on GCE node
I20260806 15:08:31.676342 7899 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:31.676582 7899 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:31.677771 7899 hybrid_clock.cc:648] HybridClock initialized: now 1786028911677753 us; error 31 us; skew 500 ppm
I20260806 15:08:31.679175 7899 webserver.cc:460] Webserver started at http://127.29.69.131:44581/ using document root <none> and password file <none>
I20260806 15:08:31.679436 7899 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:31.679510 7899 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:31.679661 7899 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:31.680718 7899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "c099252672c54a83b1cf7c7d1bf35692"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "d31086f76920662db1f27d259993ad33"
server_key_iv: "b77b177cb7cd454175d8292e8f8d6f74"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.681073 7899 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "c099252672c54a83b1cf7c7d1bf35692"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "d31086f76920662db1f27d259993ad33"
server_key_iv: "b77b177cb7cd454175d8292e8f8d6f74"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.682395 7899 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:31.683200 7913 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.683394 7899 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:31.683494 7899 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "c099252672c54a83b1cf7c7d1bf35692"
format_stamp: "Formatted at 2026-08-06 15:08:31 on dist-test-slave-tm1g"
server_key: "d31086f76920662db1f27d259993ad33"
server_key_iv: "b77b177cb7cd454175d8292e8f8d6f74"
server_key_version: "encryptionkey@0"
I20260806 15:08:31.683576 7899 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:31.686882 7899 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:31.687142 7899 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:31.687281 7899 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:31.687484 7899 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:31.687773 7899 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:31.687826 7899 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.687865 7899 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:31.687892 7899 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:31.693689 7899 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:40625
I20260806 15:08:31.693734 8028 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:40625 every 8 connection(s)
I20260806 15:08:31.694041 7899 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:08:31.696875 7609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.694751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:38745 (local address 127.29.69.190:37537)
0806 15:08:31.694805 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.694807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.695037 (+ 230us) server_negotiation.cc:407] Connection header received
0806 15:08:31.695452 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.695453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.695458 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.695510 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.696636 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:31.696637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:31.696638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:08:31.696642 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:31.696657 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:08:31.696661 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:31.696712 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:31.696810 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 15:08:31.696822 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 15:08:31.697042 8031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:31.694720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:37537 (local address 127.29.69.131:38745)
0806 15:08:31.694912 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:31.694944 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:31.695364 (+ 420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:31.695561 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:31.695564 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:31.695571 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:31.696481 (+ 910us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:08:31.696481 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:31.696516 (+ 35us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:08:31.696541 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:31.696724 (+ 183us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:31.696729 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:31.696731 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:08:31.696789 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 15:08:31.696835 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
I20260806 15:08:31.697563 8029 heartbeater.cc:347] Connected to a master server at 127.29.69.190:37537
I20260806 15:08:31.697636 8029 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:31.697790 8029 heartbeater.cc:511] Master 127.29.69.190:37537 requested a full tablet report, sending...
I20260806 15:08:31.698202 7570 ts_manager.cc:194] Registered new tserver with Master: c099252672c54a83b1cf7c7d1bf35692 (127.29.69.131:40625)
I20260806 15:08:31.700906 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 7899
I20260806 15:08:31.700980 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:31.701109 29974 external_mini_cluster.cc:1428] Setting key f93aacdd430a4c079bd8570fb3b98719
I20260806 15:08:31.702144 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260806 15:08:31.704241 7609 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:08:31.703587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54272 (local address 127.29.69.190:37537)
0806 15:08:31.703636 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:31.703638 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:31.703767 (+ 129us) server_negotiation.cc:407] Connection header received
0806 15:08:31.703850 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:31.703851 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:31.703857 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:31.703909 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:31.704156 (+ 247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54272: BlockingRecv error: recv got EOF from 127.0.0.1:54272 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:08:31.704290 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7631
I20260806 15:08:31.714282 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7765
I20260806 15:08:31.719130 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7899
I20260806 15:08:31.723690 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 7538
2026-08-06T15:08:31Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (535 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:31 dist-test-slave-tm1g krb5kdc[8039](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:31 dist-test-slave-tm1g krb5kdc[8039](info): set up 2 sockets
Aug 06 15:08:31 dist-test-slave-tm1g krb5kdc[8039](info): commencing operation
krb5kdc: starting...
W20260806 15:08:32.767735 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:32 dist-test-slave-tm1g krb5kdc[8039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:08:32.885433 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42663
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:42663
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:32.965546 8052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:32.965786 8052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:32.965821 8052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:32.966991 8052 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:08:32.967068 8052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:32.967098 8052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:32.967129 8052 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:08:32.967155 8052 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:08:32.968626 8052 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:42663
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:42663
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:32.968901 8052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:32.969134 8052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:32.973851 8060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:32.973831 8058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:32.973821 8057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:32.973861 8052 server_base.cc:1034] running on GCE node
I20260806 15:08:32.974382 8052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:32.974676 8052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:32.975837 8052 hybrid_clock.cc:648] HybridClock initialized: now 1786028912975821 us; error 28 us; skew 500 ppm
Aug 06 15:08:32 dist-test-slave-tm1g krb5kdc[8039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028912, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:32.978152 8052 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:08:32.978627 8052 webserver.cc:460] Webserver started at http://127.29.69.190:34063/ using document root <none> and password file <none>
I20260806 15:08:32.978863 8052 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:32.978932 8052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:32.979084 8052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:32.980139 8052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "588682229f36440da456bb3f11b7e578"
format_stamp: "Formatted at 2026-08-06 15:08:32 on dist-test-slave-tm1g"
server_key: "bd774da804ae18568a7f6642b1983a99"
server_key_iv: "beb0ec85f8837cfca1eb829bba99fa79"
server_key_version: "encryptionkey@0"
I20260806 15:08:32.980482 8052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "588682229f36440da456bb3f11b7e578"
format_stamp: "Formatted at 2026-08-06 15:08:32 on dist-test-slave-tm1g"
server_key: "bd774da804ae18568a7f6642b1983a99"
server_key_iv: "beb0ec85f8837cfca1eb829bba99fa79"
server_key_version: "encryptionkey@0"
I20260806 15:08:32.981760 8052 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:08:32.982491 8067 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:32.982667 8052 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:32.982767 8052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "588682229f36440da456bb3f11b7e578"
format_stamp: "Formatted at 2026-08-06 15:08:32 on dist-test-slave-tm1g"
server_key: "bd774da804ae18568a7f6642b1983a99"
server_key_iv: "beb0ec85f8837cfca1eb829bba99fa79"
server_key_version: "encryptionkey@0"
I20260806 15:08:32.982851 8052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:32.995725 8052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:32.997397 8052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:32.997563 8052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:33.001596 8052 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:42663
I20260806 15:08:33.001649 8120 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:42663 every 8 connection(s)
I20260806 15:08:33.001994 8052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:08:33.003046 8121 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:33.005290 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578: Bootstrap starting.
I20260806 15:08:33.005842 8121 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:33.006098 8121 log.cc:824] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:33.006857 8121 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578: No bootstrap required, opened a new log
I20260806 15:08:33.008442 8121 raft_consensus.cc:348] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588682229f36440da456bb3f11b7e578" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42663 } }
I20260806 15:08:33.008580 8121 raft_consensus.cc:374] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:33.008603 8121 raft_consensus.cc:729] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 588682229f36440da456bb3f11b7e578, State: Initialized, Role: FOLLOWER
I20260806 15:08:33.008746 8121 consensus_queue.cc:260] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588682229f36440da456bb3f11b7e578" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42663 } }
I20260806 15:08:33.008831 8121 raft_consensus.cc:388] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:08:33.008854 8121 raft_consensus.cc:482] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:08:33.008884 8121 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:33.009652 8121 raft_consensus.cc:504] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588682229f36440da456bb3f11b7e578" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42663 } }
I20260806 15:08:33.009744 8121 leader_election.cc:302] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 588682229f36440da456bb3f11b7e578; no voters:
I20260806 15:08:33.009938 8121 leader_election.cc:288] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:08:33.009970 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 8052
I20260806 15:08:33.009974 8124 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:33.010067 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:08:33.010160 8124 raft_consensus.cc:686] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [term 1 LEADER]: Becoming Leader. State: Replica: 588682229f36440da456bb3f11b7e578, State: Running, Role: LEADER
I20260806 15:08:33.010236 8121 sys_catalog.cc:564] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:08:33.010272 29974 external_mini_cluster.cc:1428] Setting key 975d67822e84327ca0554c689bb210b3
I20260806 15:08:33.010283 8124 consensus_queue.cc:237] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588682229f36440da456bb3f11b7e578" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42663 } }
I20260806 15:08:33.010715 8125 sys_catalog.cc:455] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 588682229f36440da456bb3f11b7e578. Latest consensus state: current_term: 1 leader_uuid: "588682229f36440da456bb3f11b7e578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588682229f36440da456bb3f11b7e578" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42663 } } }
I20260806 15:08:33.010751 8126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "588682229f36440da456bb3f11b7e578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "588682229f36440da456bb3f11b7e578" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 42663 } } }
I20260806 15:08:33.010885 8126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:33.010876 8125 sys_catalog.cc:458] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578 [sys.catalog]: This master's current role is: LEADER
I20260806 15:08:33.011315 8134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:08:33.011878 8134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:08:33.013559 8134 catalog_manager.cc:1347] Generated new cluster ID: fc357a42bcd94908972f1575bbf3a894
I20260806 15:08:33.013612 8134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028912, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:33.021574 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.010879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57432 (local address 127.29.69.190:42663)
0806 15:08:33.011057 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.011068 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.011221 (+ 153us) server_negotiation.cc:407] Connection header received
0806 15:08:33.011435 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.011443 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.011500 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.011619 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:33.012622 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.013731 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.014600 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.015032 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.015152 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.017637 (+ 2485us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:33.017641 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:33.017642 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:33.017654 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:33.019960 (+ 2306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.020335 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.020338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.020339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.020453 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.020671 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.020672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.020672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.020907 (+ 235us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:33.021094 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.021163 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.021403 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":61,"threads_started":1}
I20260806 15:08:33.022689 8134 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:08:33.023360 8134 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:08:33.035789 8134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578: Generated new TSK 0
I20260806 15:08:33.035954 8134 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:08:33.065876 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42663
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:33.148025 8147 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:33.148218 8147 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:33.148241 8147 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:33.149300 8147 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:33.149334 8147 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:33.149360 8147 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:08:33.150832 8147 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8147
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:33.151013 8147 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:33.151175 8147 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:33.156141 8155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:33.156141 8152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:33.156168 8153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:33.156306 8147 server_base.cc:1034] running on GCE node
I20260806 15:08:33.156608 8147 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:33.156888 8147 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:33.158039 8147 hybrid_clock.cc:648] HybridClock initialized: now 1786028913158029 us; error 31 us; skew 500 ppm
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028913, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:33.160651 8147 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:08:33.161060 8147 webserver.cc:460] Webserver started at http://127.29.69.129:38615/ using document root <none> and password file <none>
I20260806 15:08:33.161290 8147 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:33.161334 8147 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:33.161489 8147 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:33.162590 8147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "40bec1a49f3943c88d92160614f251cf"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "4aa0503ef18572c7cc9eddee079b55dd"
server_key_iv: "1b175b2a672742892ff3268fe3eb1e89"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.162936 8147 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "40bec1a49f3943c88d92160614f251cf"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "4aa0503ef18572c7cc9eddee079b55dd"
server_key_iv: "1b175b2a672742892ff3268fe3eb1e89"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.164278 8147 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:08:33.165066 8162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.165279 8147 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:33.165400 8147 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "40bec1a49f3943c88d92160614f251cf"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "4aa0503ef18572c7cc9eddee079b55dd"
server_key_iv: "1b175b2a672742892ff3268fe3eb1e89"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.165472 8147 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:33.177626 8147 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:33.179888 8147 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:33.179993 8147 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:33.180151 8147 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:33.180411 8147 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:33.180442 8147 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.180464 8147 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:33.180476 8147 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.186128 8147 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:46583
I20260806 15:08:33.186168 8277 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:46583 every 8 connection(s)
I20260806 15:08:33.186534 8147 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:08:33.190945 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 8147
I20260806 15:08:33.191044 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:08:33.191259 29974 external_mini_cluster.cc:1428] Setting key 608a7a14dbaf58ede6b4f7c42db17ff7
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028913, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:33.196059 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.187218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:36667 (local address 127.29.69.190:42663)
0806 15:08:33.187299 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.187301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.187474 (+ 173us) server_negotiation.cc:407] Connection header received
0806 15:08:33.187930 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.187931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.187941 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.187987 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:33.188853 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.189367 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.190288 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.190558 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.190610 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.192897 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:33.192898 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:33.192899 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:33.192905 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:33.194591 (+ 1686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.195084 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.195085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.195085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.195144 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.195437 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.195437 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.195438 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.195539 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:33.195597 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.195909 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.195985 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 15:08:33.196339 8280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.187174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42663 (local address 127.29.69.129:36667)
0806 15:08:33.187353 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.187388 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.187851 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.188042 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.188046 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.188598 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:33.188781 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.188786 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.189444 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.189445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.190218 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.190219 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.190628 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.190629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.190763 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.191304 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:33.191316 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:33.192791 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:33.194686 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:33.194694 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:33.194696 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:33.195000 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:33.195216 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:33.195217 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:33.195217 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:33.195357 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:33.195604 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:33.195610 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:33.195770 (+ 160us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.195892 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.196077 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260806 15:08:33.196919 8278 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42663
I20260806 15:08:33.197011 8278 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:33.197201 8278 heartbeater.cc:511] Master 127.29.69.190:42663 requested a full tablet report, sending...
I20260806 15:08:33.197695 8084 ts_manager.cc:194] Registered new tserver with Master: 40bec1a49f3943c88d92160614f251cf (127.29.69.129:46583)
I20260806 15:08:33.198295 8084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:36667
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:08:33.217221 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42663
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:33.296954 8284 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:33.297147 8284 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:33.297169 8284 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:33.298286 8284 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:33.298353 8284 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:33.298382 8284 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:08:33.299811 8284 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8284
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:33.300050 8284 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:33.300289 8284 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:33.305384 8292 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:33.305382 8289 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:33.305431 8284 server_base.cc:1034] running on GCE node
W20260806 15:08:33.305377 8290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:33.305804 8284 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:33.306047 8284 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:33.307214 8284 hybrid_clock.cc:648] HybridClock initialized: now 1786028913307191 us; error 36 us; skew 500 ppm
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028913, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:33.309608 8284 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:08:33.310087 8284 webserver.cc:460] Webserver started at http://127.29.69.130:34337/ using document root <none> and password file <none>
I20260806 15:08:33.310393 8284 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:33.310464 8284 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:33.310616 8284 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:33.311801 8284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "3a03ad773fd848c19ff5bbfa8d4424b3"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "341220e882b0344f7441055d30b55da5"
server_key_iv: "5c979368c000b05b5644f9e99e003f60"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.312247 8284 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "3a03ad773fd848c19ff5bbfa8d4424b3"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "341220e882b0344f7441055d30b55da5"
server_key_iv: "5c979368c000b05b5644f9e99e003f60"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.313553 8284 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:08:33.314266 8301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.314461 8284 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:08:33.314548 8284 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "3a03ad773fd848c19ff5bbfa8d4424b3"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "341220e882b0344f7441055d30b55da5"
server_key_iv: "5c979368c000b05b5644f9e99e003f60"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.314600 8284 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:33.338204 8284 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:33.340582 8284 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:33.340698 8284 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:33.340889 8284 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:33.341224 8284 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:33.341260 8284 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.341282 8284 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:33.341318 8284 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.346998 8284 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:45483
I20260806 15:08:33.347087 8417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:45483 every 8 connection(s)
I20260806 15:08:33.347406 8284 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:08:33.351766 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 8284
I20260806 15:08:33.351868 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:08:33.352100 29974 external_mini_cluster.cc:1428] Setting key 1e380ac2a89a1e655e6b2f771a9f778f
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028913, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:33.357057 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.348178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:45037 (local address 127.29.69.190:42663)
0806 15:08:33.348266 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.348269 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.348423 (+ 154us) server_negotiation.cc:407] Connection header received
0806 15:08:33.348901 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.348902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.348912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.348965 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:33.349858 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.350434 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.351373 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.351555 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.351607 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.353950 (+ 2343us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:33.353951 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:33.353952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:33.353959 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:33.355623 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.356004 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.356005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.356006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.356079 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.356312 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.356313 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.356314 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.356466 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:33.356545 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.356846 (+ 301us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.356934 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260806 15:08:33.357086 8420 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.348123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42663 (local address 127.29.69.130:45037)
0806 15:08:33.348295 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.348330 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.348811 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.349040 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.349043 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.349595 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:33.349780 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.349785 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.350509 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.350510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.351297 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.351298 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.351652 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.351653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.351802 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.352353 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:33.352362 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:33.353846 (+ 1484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:33.355712 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:33.355719 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:33.355720 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:33.355927 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:33.356151 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:33.356151 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:33.356152 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:33.356244 (+ 92us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:33.356560 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:33.356567 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:33.356709 (+ 142us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.356794 (+ 85us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.356912 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260806 15:08:33.357657 8418 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42663
I20260806 15:08:33.357746 8418 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:33.357933 8418 heartbeater.cc:511] Master 127.29.69.190:42663 requested a full tablet report, sending...
I20260806 15:08:33.358353 8084 ts_manager.cc:194] Registered new tserver with Master: 3a03ad773fd848c19ff5bbfa8d4424b3 (127.29.69.130:45483)
I20260806 15:08:33.358891 8084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:45037
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:08:33.377833 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42663
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41605
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:08:33.459774 8423 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:08:33.459968 8423 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:08:33.459991 8423 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:08:33.461119 8423 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:08:33.461160 8423 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:08:33.461216 8423 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:08:33.462649 8423 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41605
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:42663
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8423
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:08:33.462881 8423 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:08:33.463116 8423 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:08:33.468014 8429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:33.468027 8431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:08:33.468027 8428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:08:33.468318 8423 server_base.cc:1034] running on GCE node
I20260806 15:08:33.468595 8423 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:08:33.468842 8423 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:08:33.469996 8423 hybrid_clock.cc:648] HybridClock initialized: now 1786028913469983 us; error 30 us; skew 500 ppm
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028913, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:08:33.472506 8423 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:08:33.472945 8423 webserver.cc:460] Webserver started at http://127.29.69.131:42117/ using document root <none> and password file <none>
I20260806 15:08:33.473122 8423 fs_manager.cc:359] Metadata directory not provided
I20260806 15:08:33.473160 8423 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:08:33.473248 8423 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:08:33.474205 8423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "eb48f4d990c142f194b5cad071ee3174"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "fe05bac4a209d65cf9a19c554bf9f8ae"
server_key_iv: "b2ff33692cbd752464ac3fd55d1e6f0b"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.474591 8423 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "eb48f4d990c142f194b5cad071ee3174"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "fe05bac4a209d65cf9a19c554bf9f8ae"
server_key_iv: "b2ff33692cbd752464ac3fd55d1e6f0b"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.475828 8423 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:08:33.476505 8438 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.476683 8423 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:08:33.476790 8423 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "eb48f4d990c142f194b5cad071ee3174"
format_stamp: "Formatted at 2026-08-06 15:08:33 on dist-test-slave-tm1g"
server_key: "fe05bac4a209d65cf9a19c554bf9f8ae"
server_key_iv: "b2ff33692cbd752464ac3fd55d1e6f0b"
server_key_version: "encryptionkey@0"
I20260806 15:08:33.476868 8423 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:08:33.494139 8423 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:08:33.496831 8423 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:08:33.496948 8423 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:08:33.497129 8423 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:08:33.497375 8423 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:08:33.497414 8423 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.497437 8423 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:08:33.497457 8423 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:08:33.503394 8423 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:35147
I20260806 15:08:33.503438 8554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:35147 every 8 connection(s)
I20260806 15:08:33.503752 8423 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8039](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028913, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:08:33.512547 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 8423
I20260806 15:08:33.512691 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:08:33.512884 29974 external_mini_cluster.cc:1428] Setting key d42f90ee8823fc76d38bb67f61d3d284
I20260806 15:08:33.513368 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.504427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:59677 (local address 127.29.69.190:42663)
0806 15:08:33.504504 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.504506 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.504711 (+ 205us) server_negotiation.cc:407] Connection header received
0806 15:08:33.505167 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.505168 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.505179 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.505233 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:33.506149 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.506795 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.507767 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.507986 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.508050 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.510162 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:33.510163 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:33.510164 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:33.510171 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:33.511808 (+ 1637us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.512195 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.512196 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.512197 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.512271 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.512588 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.512588 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.512589 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.512772 (+ 183us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:33.512842 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.513154 (+ 312us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.513265 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:08:33.513540 8557 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.504406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:42663 (local address 127.29.69.131:59677)
0806 15:08:33.504591 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.504626 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.505081 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.505293 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.505296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.505850 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:08:33.506031 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.506036 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.506884 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.506884 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.507679 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.507682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.508067 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.508067 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.508164 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.508676 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:08:33.508685 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:08:33.510036 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:08:33.511876 (+ 1840us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:33.511883 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:33.511884 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:33.512096 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:33.512374 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:08:33.512375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:08:33.512375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:08:33.512516 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:08:33.512835 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:08:33.512842 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:08:33.512998 (+ 156us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.513111 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.513322 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":107,"threads_started":1}
I20260806 15:08:33.514027 8555 heartbeater.cc:347] Connected to a master server at 127.29.69.190:42663
I20260806 15:08:33.514103 8555 heartbeater.cc:464] Registering TS with master...
I20260806 15:08:33.514236 8555 heartbeater.cc:511] Master 127.29.69.190:42663 requested a full tablet report, sending...
I20260806 15:08:33.514628 8084 ts_manager.cc:194] Registered new tserver with Master: eb48f4d990c142f194b5cad071ee3174 (127.29.69.131:35147)
I20260806 15:08:33.514967 8084 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:59677
I20260806 15:08:33.524688 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:08:33.531761 8131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.525991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57438 (local address 127.29.69.190:42663)
0806 15:08:33.526062 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.526064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.526158 (+ 94us) server_negotiation.cc:407] Connection header received
0806 15:08:33.526196 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.526197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.526206 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.526263 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:08:33.526821 (+ 558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.527344 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.528029 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.528227 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.528297 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.529387 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:08:33.529388 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:08:33.529388 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:08:33.529394 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:08:33.530792 (+ 1398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.531097 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.531098 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.531098 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.531161 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:08:33.531320 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:08:33.531321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:08:33.531321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:08:33.531464 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:08:33.531542 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.531623 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.531695 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:08:33.533321 8084 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57438:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:08:33.535135 8084 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:08:33.541666 8566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.537767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:46583 (local address 127.0.0.1:33854)
0806 15:08:33.538109 (+ 342us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.538117 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.538158 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.538352 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.538355 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.538357 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:33.538424 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.538426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.539384 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.539386 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.540542 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.540545 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.541346 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.541347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.541426 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.541439 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.541535 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.541597 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":43,"threads_started":1}
I20260806 15:08:33.541679 8570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.537889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33854 (local address 127.29.69.129:46583)
0806 15:08:33.538079 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.538083 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.538154 (+ 71us) server_negotiation.cc:407] Connection header received
0806 15:08:33.538223 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.538226 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.538241 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.538348 (+ 107us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:33.538526 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.539275 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.540630 (+ 1355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.541259 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.541347 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.541406 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.541554 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.541595 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":79,"threads_started":1}
I20260806 15:08:33.542126 8567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.537703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57810 (local address 127.29.69.130:45483)
0806 15:08:33.537907 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.537912 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.537974 (+ 62us) server_negotiation.cc:407] Connection header received
0806 15:08:33.538069 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.538072 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.538088 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.538184 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:33.538658 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.539720 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.540962 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.541630 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.541703 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.541760 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.541985 (+ 225us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.542032 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":89,"threads_started":1}
I20260806 15:08:33.542403 8565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.537594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:35147 (local address 127.0.0.1:38102)
0806 15:08:33.537959 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.537970 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.538023 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.538462 (+ 439us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.538463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.538465 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:33.538520 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.538522 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.539814 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.539815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.540830 (+ 1015us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.540832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.542005 (+ 1173us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.542006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.542058 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.542062 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.542093 (+ 31us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.542132 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":350,"mutex_wait_us":29,"thread_start_us":54,"threads_started":1}
I20260806 15:08:33.542405 8568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.537594 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:45483 (local address 127.0.0.1:57810)
0806 15:08:33.537869 (+ 275us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.537908 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.537981 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.538502 (+ 521us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.538503 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.538505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:33.538558 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.538560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.539825 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.539826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.540857 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.540859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.541799 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.541801 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.541895 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.541900 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.542218 (+ 318us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.542261 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":30,"thread_start_us":44,"threads_started":1}
I20260806 15:08:33.542480 8211 tablet_service.cc:1467] Processing CreateTablet for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba (DEFAULT_TABLE table=test-table [id=de126496e7f348419e42a17ac80c963e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:33.542873 8569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.537769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38102 (local address 127.29.69.131:35147)
0806 15:08:33.538276 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.538279 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.538287 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:08:33.538341 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.538343 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.538357 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.538456 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:33.538594 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.539692 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.540926 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.541630 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.542367 (+ 737us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.542712 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.542738 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.542783 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":99,"threads_started":1}
I20260806 15:08:33.542902 8211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:33.543429 8350 tablet_service.cc:1467] Processing CreateTablet for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba (DEFAULT_TABLE table=test-table [id=de126496e7f348419e42a17ac80c963e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:33.543480 8488 tablet_service.cc:1467] Processing CreateTablet for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba (DEFAULT_TABLE table=test-table [id=de126496e7f348419e42a17ac80c963e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:08:33.543747 8350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:33.543805 8488 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:08:33.546130 8571 tablet_bootstrap.cc:492] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Bootstrap starting.
I20260806 15:08:33.546489 8572 tablet_bootstrap.cc:492] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Bootstrap starting.
I20260806 15:08:33.546842 8571 tablet_bootstrap.cc:654] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:33.547156 8572 tablet_bootstrap.cc:654] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:33.547497 8571 log.cc:824] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:33.547513 8573 tablet_bootstrap.cc:492] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Bootstrap starting.
I20260806 15:08:33.547782 8572 log.cc:824] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:33.548164 8573 tablet_bootstrap.cc:654] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Neither blocks nor log segments found. Creating new log.
I20260806 15:08:33.548357 8571 tablet_bootstrap.cc:492] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: No bootstrap required, opened a new log
I20260806 15:08:33.548432 8571 ts_tablet_manager.cc:1397] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260806 15:08:33.548751 8573 log.cc:824] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:08:33.549537 8573 tablet_bootstrap.cc:492] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: No bootstrap required, opened a new log
I20260806 15:08:33.549605 8573 ts_tablet_manager.cc:1397] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:08:33.550484 8571 raft_consensus.cc:348] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.550648 8571 raft_consensus.cc:374] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:33.550689 8571 raft_consensus.cc:729] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb48f4d990c142f194b5cad071ee3174, State: Initialized, Role: FOLLOWER
I20260806 15:08:33.550799 8571 consensus_queue.cc:260] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.550890 8572 tablet_bootstrap.cc:492] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: No bootstrap required, opened a new log
I20260806 15:08:33.550961 8572 ts_tablet_manager.cc:1397] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 15:08:33.551084 8571 ts_tablet_manager.cc:1428] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260806 15:08:33.551214 8555 heartbeater.cc:503] Master 127.29.69.190:42663 was elected leader, sending a full tablet report...
I20260806 15:08:33.551697 8573 raft_consensus.cc:348] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.551810 8573 raft_consensus.cc:374] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:33.551829 8573 raft_consensus.cc:729] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a03ad773fd848c19ff5bbfa8d4424b3, State: Initialized, Role: FOLLOWER
I20260806 15:08:33.551931 8573 consensus_queue.cc:260] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.552214 8573 ts_tablet_manager.cc:1428] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:08:33.552245 8418 heartbeater.cc:503] Master 127.29.69.190:42663 was elected leader, sending a full tablet report...
I20260806 15:08:33.553015 8572 raft_consensus.cc:348] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.553174 8572 raft_consensus.cc:374] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:08:33.553220 8572 raft_consensus.cc:729] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40bec1a49f3943c88d92160614f251cf, State: Initialized, Role: FOLLOWER
I20260806 15:08:33.553325 8572 consensus_queue.cc:260] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.553597 8572 ts_tablet_manager.cc:1428] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:08:33.553617 8278 heartbeater.cc:503] Master 127.29.69.190:42663 was elected leader, sending a full tablet report...
W20260806 15:08:33.597963 8419 tablet.cc:2369] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:08:33.687260 8279 tablet.cc:2369] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:08:33.754278 8556 tablet.cc:2369] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:08:33.865492 8579 raft_consensus.cc:482] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:08:33.865620 8579 raft_consensus.cc:504] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.866046 8579 leader_election.cc:288] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb48f4d990c142f194b5cad071ee3174 (127.29.69.131:35147), 3a03ad773fd848c19ff5bbfa8d4424b3 (127.29.69.130:45483)
I20260806 15:08:33.869910 8567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.866733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:51969 (local address 127.29.69.130:45483)
0806 15:08:33.866780 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.866782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.866792 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:08:33.866912 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.866914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.866927 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.866961 (+ 34us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:33.867206 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.867690 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.868974 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.869548 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.869623 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.869632 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.869801 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.869839 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 15:08:33.869910 8569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.866463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:50669 (local address 127.29.69.131:35147)
0806 15:08:33.866513 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.866515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.866522 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:08:33.866557 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.866558 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.866569 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.866633 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:08:33.866834 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.867492 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.868975 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.869548 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.869624 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.869632 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.869801 (+ 169us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.869839 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 15:08:33.869949 8580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.866205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:35147 (local address 127.29.69.129:50669)
0806 15:08:33.866377 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.866389 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.866454 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.866656 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.866657 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.866659 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:33.866738 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.866741 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.867577 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.867577 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.868884 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.868887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.869631 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.869632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.869717 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.869724 (+ 7us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.869783 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.869840 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":22,"thread_start_us":90,"threads_started":1}
I20260806 15:08:33.869952 8581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.866562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:45483 (local address 127.29.69.129:51969)
0806 15:08:33.866737 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.866748 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:08:33.866805 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:08:33.867038 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:08:33.867039 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:08:33.867041 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:08:33.867114 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.867116 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.867789 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.867790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.868884 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:08:33.868887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.869633 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.869634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:08:33.869717 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.869723 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 15:08:33.869783 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 15:08:33.869840 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":13,"thread_start_us":49,"threads_started":1}
I20260806 15:08:33.870330 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d7ae4e2ecd34433b4ebe37cdceaa6ba" candidate_uuid: "40bec1a49f3943c88d92160614f251cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb48f4d990c142f194b5cad071ee3174" is_pre_election: true
I20260806 15:08:33.870332 8370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d7ae4e2ecd34433b4ebe37cdceaa6ba" candidate_uuid: "40bec1a49f3943c88d92160614f251cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" is_pre_election: true
I20260806 15:08:33.870487 8370 raft_consensus.cc:2454] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40bec1a49f3943c88d92160614f251cf in term 0.
I20260806 15:08:33.870487 8509 raft_consensus.cc:2454] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40bec1a49f3943c88d92160614f251cf in term 0.
I20260806 15:08:33.870710 8164 leader_election.cc:302] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a03ad773fd848c19ff5bbfa8d4424b3, 40bec1a49f3943c88d92160614f251cf; no voters:
I20260806 15:08:33.870872 8579 raft_consensus.cc:2781] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:08:33.870929 8579 raft_consensus.cc:482] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:08:33.870956 8579 raft_consensus.cc:3037] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:33.871629 8579 raft_consensus.cc:504] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.871759 8579 leader_election.cc:288] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [CANDIDATE]: Term 1 election: Requested vote from peers eb48f4d990c142f194b5cad071ee3174 (127.29.69.131:35147), 3a03ad773fd848c19ff5bbfa8d4424b3 (127.29.69.130:45483)
I20260806 15:08:33.871938 8509 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d7ae4e2ecd34433b4ebe37cdceaa6ba" candidate_uuid: "40bec1a49f3943c88d92160614f251cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb48f4d990c142f194b5cad071ee3174"
I20260806 15:08:33.871927 8370 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6d7ae4e2ecd34433b4ebe37cdceaa6ba" candidate_uuid: "40bec1a49f3943c88d92160614f251cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3"
I20260806 15:08:33.872006 8509 raft_consensus.cc:3037] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:33.872028 8370 raft_consensus.cc:3037] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:08:33.872772 8509 raft_consensus.cc:2454] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40bec1a49f3943c88d92160614f251cf in term 1.
I20260806 15:08:33.872792 8370 raft_consensus.cc:2454] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40bec1a49f3943c88d92160614f251cf in term 1.
I20260806 15:08:33.872980 8163 leader_election.cc:302] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40bec1a49f3943c88d92160614f251cf, eb48f4d990c142f194b5cad071ee3174; no voters:
I20260806 15:08:33.873076 8579 raft_consensus.cc:2781] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:08:33.873200 8579 raft_consensus.cc:686] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 1 LEADER]: Becoming Leader. State: Replica: 40bec1a49f3943c88d92160614f251cf, State: Running, Role: LEADER
I20260806 15:08:33.873298 8579 consensus_queue.cc:237] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } }
I20260806 15:08:33.874172 8083 catalog_manager.cc:5495] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf reported cstate change: term changed from 0 to 1, leader changed from <none> to 40bec1a49f3943c88d92160614f251cf (127.29.69.129). New cstate: current_term: 1 leader_uuid: "40bec1a49f3943c88d92160614f251cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40bec1a49f3943c88d92160614f251cf" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 46583 } health_report { overall_health: HEALTHY } } }
I20260806 15:08:33.894546 8570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.892111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33868 (local address 127.29.69.129:46583)
0806 15:08:33.892156 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:08:33.892158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:08:33.892184 (+ 26us) server_negotiation.cc:407] Connection header received
0806 15:08:33.892218 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:08:33.892219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:08:33.892240 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:08:33.892315 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:08:33.892473 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.892946 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.893719 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:08:33.893931 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:08:33.894016 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:08:33.894200 (+ 184us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:08:33.894342 (+ 142us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:08:33.894422 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 15:08:33.894441 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 15:08:33.894462 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:08:33.896281 8509 raft_consensus.cc:1261] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 1 FOLLOWER]: Refusing update from remote peer 40bec1a49f3943c88d92160614f251cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:33.896327 8370 raft_consensus.cc:1261] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 1 FOLLOWER]: Refusing update from remote peer 40bec1a49f3943c88d92160614f251cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:08:33.896643 8579 consensus_queue.cc:1035] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb48f4d990c142f194b5cad071ee3174" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:33.896775 8582 consensus_queue.cc:1035] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a03ad773fd848c19ff5bbfa8d4424b3" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 45483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:08:33.899178 8586 mvcc.cc:205] Tried to move back new op lower bound from 7315574431316717568 to 7315574431225528320. Current Snapshot: MvccSnapshot[applied={T|T < 7315574431316717568}]
I20260806 15:08:33.899333 8587 mvcc.cc:205] Tried to move back new op lower bound from 7315574431316717568 to 7315574431225528320. Current Snapshot: MvccSnapshot[applied={T|T < 7315574431316717568}]
I20260806 15:08:33.901561 8083 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:33.901648 8083 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57438:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:08:33.902510 8083 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 588682229f36440da456bb3f11b7e578: Sending DeleteTablet for 3 replicas of tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba
I20260806 15:08:33.902841 8488 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:33 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:38102
I20260806 15:08:33.902853 8211 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:33 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:33854
I20260806 15:08:33.903072 8597 tablet_replica.cc:330] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: stopping tablet replica
I20260806 15:08:33.903084 8350 tablet_service.cc:1514] Processing DeleteTablet for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:08:33 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:57810
I20260806 15:08:33.903183 8597 raft_consensus.cc:2229] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:08:33.903266 8598 tablet_replica.cc:330] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: stopping tablet replica
I20260806 15:08:33.903314 8597 raft_consensus.cc:2258] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:33.903458 8598 raft_consensus.cc:2229] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:33.903605 8598 raft_consensus.cc:2258] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:33.903600 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 8147
I20260806 15:08:33.903780 8597 ts_tablet_manager.cc:1905] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 40bec1a49f3943c88d92160614f251cf: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:33.904166 8598 ts_tablet_manager.cc:1905] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:33.905519 8599 tablet_replica.cc:330] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: stopping tablet replica
I20260806 15:08:33.905622 8598 ts_tablet_manager.cc:1918] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:33.905628 8599 raft_consensus.cc:2229] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:08:33.905699 8598 log.cc:1196] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/6d7ae4e2ecd34433b4ebe37cdceaa6ba
I20260806 15:08:33.905750 8599 raft_consensus.cc:2258] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:08:33.906019 8598 ts_tablet_manager.cc:1939] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P eb48f4d990c142f194b5cad071ee3174: Deleting consensus metadata
I20260806 15:08:33.906224 8599 ts_tablet_manager.cc:1905] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:08:33.906445 8068 catalog_manager.cc:4841] TS eb48f4d990c142f194b5cad071ee3174 (127.29.69.131:35147): tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba (table test-table [id=de126496e7f348419e42a17ac80c963e]) successfully deleted
I20260806 15:08:33.908198 8599 ts_tablet_manager.cc:1918] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:08:33.908277 8599 log.cc:1196] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/6d7ae4e2ecd34433b4ebe37cdceaa6ba
I20260806 15:08:33.908512 8599 ts_tablet_manager.cc:1939] T 6d7ae4e2ecd34433b4ebe37cdceaa6ba P 3a03ad773fd848c19ff5bbfa8d4424b3: Deleting consensus metadata
I20260806 15:08:33.908931 8069 catalog_manager.cc:4841] TS 3a03ad773fd848c19ff5bbfa8d4424b3 (127.29.69.130:45483): tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba (table test-table [id=de126496e7f348419e42a17ac80c963e]) successfully deleted
W20260806 15:08:33.911149 8068 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:46583 (error 108)
I20260806 15:08:33.911355 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 8284
I20260806 15:08:33.911675 8568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:08:33.911567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:46583 (local address 127.0.0.1:33882)
0806 15:08:33.911609 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:08:33.911639 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:46583: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260806 15:08:33.911777 8068 catalog_manager.cc:4584] TS 40bec1a49f3943c88d92160614f251cf (127.29.69.129:46583): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6d7ae4e2ecd34433b4ebe37cdceaa6ba: Network error: Client connection negotiation failed: client connection to 127.29.69.129:46583: connect: Connection refused (error 111)
I20260806 15:08:33.916884 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 8423
I20260806 15:08:33.921911 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 8052
2026-08-06T15:08:33Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2199 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8603](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8603](info): set up 2 sockets
Aug 06 15:08:33 dist-test-slave-tm1g krb5kdc[8603](info): commencing operation
krb5kdc: starting...
W20260806 15:08:34.967440 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:08:35 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028915, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:08:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:08:35Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/rangeradmin_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/rangeradmin_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/rangerlookup_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/rangerlookup_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
I20260806 15:08:35.126746 29974 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJcRv5_/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/postgres -l logfile start
2026-08-06 15:08:37.558 UTC [8634] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 15:08:37.558 UTC [8634] LOG: listening on IPv4 address "127.29.69.148", port 36697
2026-08-06 15:08:37.562 UTC [8634] LOG: listening on Unix socket "/tmp/.s.PGSQL.36697"
2026-08-06 15:08:37.584 UTC [8637] LOG: database system was shut down at 2026-08-06 15:08:36 UTC
2026-08-06 15:08:37.587 UTC [8634] LOG: database system is ready to accept connections
I20260806 15:08:38.547784 29974 mini_postgres.cc:96] Postgres bound to 36697
2026-08-06 15:08:38.554 UTC [8645] FATAL: database "slave" does not exist
127.29.69.148:36697 - accepting connections
I20260806 15:08:38.555752 29974 mini_ranger.cc:161] Starting Ranger...
I20260806 15:08:38.573212 29974 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 15:08:39.038671 29974 mini_ranger.cc:87] Created ranger Postgres database
I20260806 15:08:39.038743 29974 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-admin
2026-08-06 15:08:39,383 [I] DB FLAVOR :POSTGRES
2026-08-06 15:08:39,383 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 15:08:39,383 [I] Checking connection..
2026-08-06 15:08:39,384 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 15:08:39,653 [I] Checking connection passed.
2026-08-06 15:08:39,654 [I] --------- Verifying version history table ---------
2026-08-06 15:08:39,654 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 15:08:39,892 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 15:08:39,892 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 15:08:40,151 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 15:08:40,152 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 15:08:40,152 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 15:08:40.403 UTC [8709] WARNING: there is no transaction in progress
2026-08-06 15:08:40,410 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 15:08:40,410 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 15:08:40,671 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 15:08:40,672 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 15:08:40,672 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 15:08:40,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 15:08:41,174 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tm1g.c.gcp-upstream.internal','N') ;"
2026-08-06 15:08:41,414 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 15:08:41,659 [I] Table x_portal_user does not exist in database ranger
2026-08-06 15:08:41,660 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 15:08:41,903 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 15:08:41,903 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 15:08:42,151 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 15:08:42,413 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 15:08:42,413 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 15:08:43.362 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.379 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.394 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.410 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.428 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.445 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.500 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.506 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.520 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.531 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.541 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.554 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.563 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.570 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.576 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:43.583 UTC [8822] WARNING: there is no transaction in progress
2026-08-06 15:08:44,207 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 15:08:44,207 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 15:08:44,459 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 15:08:44,460 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 15:08:44,716 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 15:08:44,716 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 15:08:44,972 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 15:08:44,973 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 15:08:45,232 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 15:08:45,487 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tm1g.c.gcp-upstream.internal';"
2026-08-06 15:08:45,736 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 15:08:45,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 15:08:45,993 [I] DB_PATCHES have already been applied
I20260806 15:08:45.998835 29974 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJcRv5_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 15:08:45.998898 29974 mini_ranger.cc:193] Using host: 127.29.69.148
I20260806 15:08:46.002054 29974 mini_ranger.cc:227] Ranger admin URL: http://127.29.69.148:48531
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 3:08:46 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 15:08:47.126808 29974 mini_ranger.cc:160] Time spent starting Ranger: real 8.571s user 0.000s sys 0.010s
Aug 06, 2026 3:09:07 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 3:09:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 3:09:07 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 3:09:07 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 3:09:08 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 15:09:08.753145 29974 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/rangerkms_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/rangerkms_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.69.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.69.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 15:09:08 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028948, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 15:09:08.840441 29974 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 15:09:08.852582 29974 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 15:09:09.592574 29974 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 15:09:09.592664 29974 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms
I20260806 15:09:09.592684 29974 mini_ranger_kms.cc:227] Using postgres at 127.29.69.148:36697
2026-08-06 15:09:10,321 [I] DB FLAVOR :POSTGRES
2026-08-06 15:09:10,321 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 15:09:10,321 [I] Checking connection
2026-08-06 15:09:10,321 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 15:09:10,689 [I] connection success
2026-08-06 15:09:10,689 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 15:09:10,689 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 15:09:10,689 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 15:09:10,926 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 15:09:10,926 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 15:09:10,926 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 15:09:10,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:36697/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 15:09:11,219 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 15:09:11.690428 29974 mini_ranger_kms.cc:310] Created kms service
I20260806 15:09:11.889390 29974 mini_ranger_kms.cc:326] Created kudu user
I20260806 15:09:11.936757 29974 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 15:09:11 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028948, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:09:12.356637 29974 mini_ranger_kms.cc:384] Added ranger policy
I20260806 15:09:12.356763 29974 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 15:09:12.356786 29974 mini_ranger_kms.cc:240] Using host: 127.29.69.148
I20260806 15:09:12.360325 29974 mini_ranger_kms.cc:276] Ranger KMS PID: 9010
I20260806 15:09:12.360450 29974 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.69.148:53511
Aug 06, 2026 3:09:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 3:09:13 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 3:09:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 3:09:13 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 3:09:14 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 3:09:14 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 15:09:14.636138 29974 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.796s user 0.000s sys 0.660s
I20260806 15:09:14.636266 29974 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 15:09:14.636363 29974 mini_ranger_kms.cc:401] 127.29.69.148:53511/kms/v1/keys
Aug 06 15:09:14 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786028954, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.69.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 15:09:15 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028954, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.69.148@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
Aug 06 15:09:15 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028954, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.69.148@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
Aug 06 15:09:18 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:09:18.321951 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46881
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46881
--ranger_config_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:53511/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:09:18.529597 9064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:09:18.529798 9064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:09:18.529821 9064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:09:18.531073 9064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:09:18.531117 9064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:09:18.531132 9064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:09:18.531144 9064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:09:18.531157 9064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:09:18.532838 9064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.69.148:53511/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46881
--ranger_config_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9064
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:09:18.533082 9064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:09:18.533349 9064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:09:18.539671 9069 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:09:18.539796 9064 server_base.cc:1034] running on GCE node
W20260806 15:09:18.539886 9072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:09:18.539947 9070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:09:18.540341 9064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:09:18.540683 9064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:09:18.541879 9064 hybrid_clock.cc:648] HybridClock initialized: now 1786028958541850 us; error 45 us; skew 500 ppm
Aug 06 15:09:18 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028958, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:09:18.549901 9064 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:09:18.550446 9064 webserver.cc:460] Webserver started at http://127.29.69.190:40501/ using document root <none> and password file <none>
I20260806 15:09:18.550678 9064 fs_manager.cc:359] Metadata directory not provided
I20260806 15:09:18.550726 9064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:09:18.550848 9064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:09:18 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028958, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:09:18.603971 9064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "1ef20731165b42e3b7ccea20a2291702"
format_stamp: "Formatted at 2026-08-06 15:09:18 on dist-test-slave-tm1g"
server_key: "3d2c97b2586f12a968e7e46a7fa274ec"
server_key_iv: "9654c088e00d6dd8b78bcd454513501c"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:18.604442 9064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "1ef20731165b42e3b7ccea20a2291702"
format_stamp: "Formatted at 2026-08-06 15:09:18 on dist-test-slave-tm1g"
server_key: "3d2c97b2586f12a968e7e46a7fa274ec"
server_key_iv: "9654c088e00d6dd8b78bcd454513501c"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:18.606051 9064 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:09:18.621459 9079 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:18.621693 9064 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:09:18.621799 9064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "1ef20731165b42e3b7ccea20a2291702"
format_stamp: "Formatted at 2026-08-06 15:09:18 on dist-test-slave-tm1g"
server_key: "3d2c97b2586f12a968e7e46a7fa274ec"
server_key_iv: "9654c088e00d6dd8b78bcd454513501c"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:18.621908 9064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:09:18.644657 9064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:09:18.646935 9064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:09:18.647147 9064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:09:18.656658 9064 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:46881
I20260806 15:09:18.656719 9133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:46881 every 8 connection(s)
I20260806 15:09:18.657126 9064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:09:18.658062 9134 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:09:18.661158 9134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702: Bootstrap starting.
I20260806 15:09:18.661655 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 9064
I20260806 15:09:18.661759 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:09:18.661944 29974 external_mini_cluster.cc:1428] Setting key 1706bd987245388342cdce4055885ec6
I20260806 15:09:18.662055 9134 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702: Neither blocks nor log segments found. Creating new log.
I20260806 15:09:18.662761 9134 log.cc:824] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702: Log is configured to *not* fsync() on all Append() calls
I20260806 15:09:18.663628 9134 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702: No bootstrap required, opened a new log
I20260806 15:09:18.666899 9134 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef20731165b42e3b7ccea20a2291702" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46881 } }
I20260806 15:09:18.667079 9134 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:09:18.667114 9134 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ef20731165b42e3b7ccea20a2291702, State: Initialized, Role: FOLLOWER
I20260806 15:09:18.667268 9134 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef20731165b42e3b7ccea20a2291702" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46881 } }
I20260806 15:09:18.667380 9134 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:09:18.667414 9134 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:09:18.667457 9134 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:09:18.668565 9134 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef20731165b42e3b7ccea20a2291702" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46881 } }
I20260806 15:09:18.668677 9134 leader_election.cc:302] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1ef20731165b42e3b7ccea20a2291702; no voters:
I20260806 15:09:18.668859 9134 leader_election.cc:288] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:09:18.669093 9140 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:09:18.669277 9134 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:09:18.669416 9140 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [term 1 LEADER]: Becoming Leader. State: Replica: 1ef20731165b42e3b7ccea20a2291702, State: Running, Role: LEADER
I20260806 15:09:18.669621 9140 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef20731165b42e3b7ccea20a2291702" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46881 } }
I20260806 15:09:18.670137 9140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1ef20731165b42e3b7ccea20a2291702" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef20731165b42e3b7ccea20a2291702" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46881 } } }
Aug 06 15:09:18 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028958, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:09:18.670419 9140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [sys.catalog]: This master's current role is: LEADER
I20260806 15:09:18.670719 9140 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1ef20731165b42e3b7ccea20a2291702. Latest consensus state: current_term: 1 leader_uuid: "1ef20731165b42e3b7ccea20a2291702" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1ef20731165b42e3b7ccea20a2291702" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46881 } } }
I20260806 15:09:18.670842 9140 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702 [sys.catalog]: This master's current role is: LEADER
I20260806 15:09:18.671505 9149 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:09:18.672557 9149 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:09:18.674389 9134 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 15:09:18.675971 9137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:18.662535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48174 (local address 127.29.69.190:46881)
0806 15:09:18.662727 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:18.662736 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:18.662769 (+ 33us) server_negotiation.cc:407] Connection header received
0806 15:09:18.663362 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:18.663385 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:18.663449 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:18.663598 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:09:18.664588 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:18.666067 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:18.667227 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:18.668001 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:18.668142 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:18.670845 (+ 2703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:09:18.670849 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:09:18.670849 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:09:18.670861 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:09:18.673364 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:18.673832 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:18.673835 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:18.673836 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:18.673951 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:18.674232 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:18.674233 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:18.674233 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:18.674623 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:09:18.674843 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:18.675586 (+ 743us) server_negotiation.cc:299] Negotiation successful
0806 15:09:18.675707 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":77,"threads_started":1}
I20260806 15:09:18.676908 9149 catalog_manager.cc:1347] Generated new cluster ID: c7575539132d4fd5a97576b3f5a9ef6c
I20260806 15:09:18.676962 9149 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:09:18.692955 9149 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:09:18.693985 9149 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:09:18.704151 9149 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702: Generated new TSK 0
I20260806 15:09:18.704331 9149 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:09:19.613731 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:53511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46881
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:09:19.761232 9181 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:09:19.761487 9181 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:09:19.761528 9181 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:09:19.762861 9181 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:09:19.762931 9181 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:09:19.762979 9181 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:09:19.764667 9181 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.69.148:53511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9181
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:09:19.764932 9181 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:09:19.765187 9181 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:09:19.771636 9188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:09:19.771648 9187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:09:19.771932 9190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:09:19.772857 9181 server_base.cc:1034] running on GCE node
I20260806 15:09:19.773159 9181 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:09:19.773504 9181 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:09:19.774725 9181 hybrid_clock.cc:648] HybridClock initialized: now 1786028959774704 us; error 43 us; skew 500 ppm
Aug 06 15:09:19 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028959, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:09:19.777974 9181 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:09:19.778546 9181 webserver.cc:460] Webserver started at http://127.29.69.129:39839/ using document root <none> and password file <none>
I20260806 15:09:19.778831 9181 fs_manager.cc:359] Metadata directory not provided
I20260806 15:09:19.778905 9181 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:09:19.779045 9181 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:09:19 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028959, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:09:19.794008 9181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "e466301046ec40bf8f6f35a4b4682cec"
format_stamp: "Formatted at 2026-08-06 15:09:19 on dist-test-slave-tm1g"
server_key: "005a01443aa1f80b44a46b826b88bd8d"
server_key_iv: "86fb02dba03b9fcd0676952e14553bdd"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:19.794600 9181 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "e466301046ec40bf8f6f35a4b4682cec"
format_stamp: "Formatted at 2026-08-06 15:09:19 on dist-test-slave-tm1g"
server_key: "005a01443aa1f80b44a46b826b88bd8d"
server_key_iv: "86fb02dba03b9fcd0676952e14553bdd"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:19.796839 9181 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:09:19.809787 9198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:19.810039 9181 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:09:19.810146 9181 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "e466301046ec40bf8f6f35a4b4682cec"
format_stamp: "Formatted at 2026-08-06 15:09:19 on dist-test-slave-tm1g"
server_key: "005a01443aa1f80b44a46b826b88bd8d"
server_key_iv: "86fb02dba03b9fcd0676952e14553bdd"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:19.810263 9181 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:09:19.830533 9181 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:09:19.832564 9181 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:09:19.832743 9181 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:09:19.833163 9181 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:09:19.833639 9181 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:09:19.833707 9181 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:19.833782 9181 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:09:19.833828 9181 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:19.849304 9181 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:41805
I20260806 15:09:19.849730 9181 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:09:19.850632 9313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:41805 every 8 connection(s)
I20260806 15:09:19.854089 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 9181
I20260806 15:09:19.854216 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:09:19.854441 29974 external_mini_cluster.cc:1428] Setting key 2a702b6e108bd2216e8e41a841a297a7
Aug 06 15:09:19 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028959, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:09:19.870566 9316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:19.850869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:54723 (local address 127.29.69.190:46881)
0806 15:09:19.859029 (+ 8160us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:19.859032 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:19.859040 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:09:19.859064 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:19.859065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:19.859078 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:19.859143 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:09:19.860364 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:19.861177 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:19.862756 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:19.863081 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:19.863120 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:19.865982 (+ 2862us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:09:19.865983 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:09:19.865984 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:09:19.866004 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:09:19.868421 (+ 2417us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:19.868999 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:19.869000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:19.869001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:19.869072 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:19.869375 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:19.869376 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:19.869376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:19.869601 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:09:19.869708 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:19.870391 (+ 683us) server_negotiation.cc:299] Negotiation successful
0806 15:09:19.870474 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8136,"thread_start_us":70,"threads_started":1}
I20260806 15:09:19.870604 9317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:19.850841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46881 (local address 127.29.69.129:54723)
0806 15:09:19.857825 (+ 6984us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:19.857886 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:19.858827 (+ 941us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:19.859270 (+ 443us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:19.859275 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:19.859741 (+ 466us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:09:19.860245 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:19.860253 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:19.861292 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:19.861293 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:19.862652 (+ 1359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:19.862655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:19.863214 (+ 559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:19.863214 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:19.863380 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:19.864071 (+ 691us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:09:19.864082 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:09:19.865868 (+ 1786us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:09:19.868531 (+ 2663us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:09:19.868539 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:09:19.868542 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:09:19.868872 (+ 330us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:09:19.869151 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:09:19.869152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:09:19.869152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:09:19.869296 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:09:19.869755 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:09:19.869762 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:09:19.869977 (+ 215us) client_negotiation.cc:769] Sending connection context
0806 15:09:19.870099 (+ 122us) client_negotiation.cc:240] Negotiation successful
0806 15:09:19.870295 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6911,"thread_start_us":150,"threads_started":1}
I20260806 15:09:19.871558 9314 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46881
I20260806 15:09:19.871714 9314 heartbeater.cc:464] Registering TS with master...
I20260806 15:09:19.871954 9314 heartbeater.cc:511] Master 127.29.69.190:46881 requested a full tablet report, sending...
I20260806 15:09:19.872560 9097 ts_manager.cc:194] Registered new tserver with Master: e466301046ec40bf8f6f35a4b4682cec (127.29.69.129:41805)
I20260806 15:09:19.873188 9097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:54723
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:09:19.897881 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:53511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46881
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:09:20.050696 9323 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:09:20.051039 9323 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:09:20.051127 9323 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:09:20.052877 9323 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:09:20.052934 9323 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:09:20.052974 9323 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:09:20.055109 9323 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.69.148:53511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9323
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:09:20.055675 9323 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:09:20.056023 9323 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:09:20.077831 9333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:09:20.078702 9332 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:09:20.079751 9323 server_base.cc:1034] running on GCE node
W20260806 15:09:20.081518 9335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:09:20.081869 9323 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:09:20.082175 9323 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:09:20.083364 9323 hybrid_clock.cc:648] HybridClock initialized: now 1786028960083342 us; error 34 us; skew 500 ppm
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:09:20.088023 9323 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:09:20.088716 9323 webserver.cc:460] Webserver started at http://127.29.69.130:38103/ using document root <none> and password file <none>
I20260806 15:09:20.089061 9323 fs_manager.cc:359] Metadata directory not provided
I20260806 15:09:20.089192 9323 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:09:20.089398 9323 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:09:20.114418 9323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "1f3247c0ce76464297a4599ab709f3d9"
format_stamp: "Formatted at 2026-08-06 15:09:20 on dist-test-slave-tm1g"
server_key: "f6919352a696296e8ddd9893750cb9f9"
server_key_iv: "afa293c4d94340f2b65e0b72c6f32ce0"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:20.115283 9323 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "1f3247c0ce76464297a4599ab709f3d9"
format_stamp: "Formatted at 2026-08-06 15:09:20 on dist-test-slave-tm1g"
server_key: "f6919352a696296e8ddd9893750cb9f9"
server_key_iv: "afa293c4d94340f2b65e0b72c6f32ce0"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:20.117764 9323 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260806 15:09:20.134446 9342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:20.134701 9323 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:09:20.134800 9323 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "1f3247c0ce76464297a4599ab709f3d9"
format_stamp: "Formatted at 2026-08-06 15:09:20 on dist-test-slave-tm1g"
server_key: "f6919352a696296e8ddd9893750cb9f9"
server_key_iv: "afa293c4d94340f2b65e0b72c6f32ce0"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:20.134899 9323 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:09:20.169193 9323 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:09:20.171949 9323 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:09:20.172189 9323 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:09:20.172616 9323 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:09:20.173025 9323 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:09:20.173110 9323 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:20.173182 9323 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:09:20.173215 9323 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:20.188969 9323 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:36029
I20260806 15:09:20.189615 9323 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:09:20.190450 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 9323
I20260806 15:09:20.190570 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:09:20.190814 29974 external_mini_cluster.cc:1428] Setting key dcbbb9788cbc0344a7f7b2b95f2693d3
I20260806 15:09:20.192039 9458 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:36029 every 8 connection(s)
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:09:20.203773 9316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.191808 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:36569 (local address 127.29.69.190:46881)
0806 15:09:20.191853 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.191855 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.192458 (+ 603us) server_negotiation.cc:407] Connection header received
0806 15:09:20.193418 (+ 960us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.193419 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.193436 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.193465 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:09:20.194448 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.195220 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.196756 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.197132 (+ 376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.197179 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.200306 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:09:20.200307 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:09:20.200307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:09:20.200315 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:09:20.202035 (+ 1720us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:20.202582 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:20.202583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:20.202584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:20.202647 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:20.202932 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:20.202933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:20.202934 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:20.203074 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:09:20.203130 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.203488 (+ 358us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.203620 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:09:20.204365 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.191424 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46881 (local address 127.29.69.130:36569)
0806 15:09:20.192307 (+ 883us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.192351 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.193289 (+ 938us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.193665 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.193670 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.193984 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:09:20.194337 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.194344 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.195345 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.195346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.196652 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.196655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.197276 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.197277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.197482 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.198345 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:09:20.198355 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:09:20.200200 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:09:20.202133 (+ 1933us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:09:20.202139 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:09:20.202142 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:09:20.202469 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:09:20.202721 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:09:20.202722 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:09:20.202722 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:09:20.202858 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:09:20.203166 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:09:20.203173 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:09:20.203337 (+ 164us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.203961 (+ 624us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.204120 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":813,"thread_start_us":188,"threads_started":1}
I20260806 15:09:20.205037 9459 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46881
I20260806 15:09:20.205128 9459 heartbeater.cc:464] Registering TS with master...
I20260806 15:09:20.205307 9459 heartbeater.cc:511] Master 127.29.69.190:46881 requested a full tablet report, sending...
I20260806 15:09:20.205698 9097 ts_manager.cc:194] Registered new tserver with Master: 1f3247c0ce76464297a4599ab709f3d9 (127.29.69.130:36029)
I20260806 15:09:20.206157 9097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:36569
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:09:20.233772 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:53511/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46881
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:09:20.397825 9465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:09:20.398221 9465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:09:20.398337 9465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:09:20.400730 9465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:09:20.400867 9465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:09:20.400971 9465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:09:20.403825 9465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.69.148:53511/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:09:20.404354 9465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:09:20.404796 9465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:09:20.414779 9475 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:09:20.415076 9473 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:09:20.415357 9472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:09:20.416608 9465 server_base.cc:1034] running on GCE node
I20260806 15:09:20.416842 9465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:09:20.417147 9465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:09:20.418351 9465 hybrid_clock.cc:648] HybridClock initialized: now 1786028960418327 us; error 35 us; skew 500 ppm
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:09:20.422991 9465 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:09:20.423645 9465 webserver.cc:460] Webserver started at http://127.29.69.131:39711/ using document root <none> and password file <none>
I20260806 15:09:20.424031 9465 fs_manager.cc:359] Metadata directory not provided
I20260806 15:09:20.424177 9465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:09:20.424368 9465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:09:20.455066 9465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "192c15d7fdb1483992e3c98f86a6a8a3"
format_stamp: "Formatted at 2026-08-06 15:09:20 on dist-test-slave-tm1g"
server_key: "43b5083f8031bf6ebe088502a6aab72e"
server_key_iv: "7a20d4dfca3065b21bebb529b80fb5d9"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:20.456106 9465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "192c15d7fdb1483992e3c98f86a6a8a3"
format_stamp: "Formatted at 2026-08-06 15:09:20 on dist-test-slave-tm1g"
server_key: "43b5083f8031bf6ebe088502a6aab72e"
server_key_iv: "7a20d4dfca3065b21bebb529b80fb5d9"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:20.466849 9465 fs_manager.cc:691] Time spent creating directory manager: real 0.009s user 0.002s sys 0.000s
I20260806 15:09:20.489745 9483 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:20.490046 9465 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260806 15:09:20.490152 9465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "192c15d7fdb1483992e3c98f86a6a8a3"
format_stamp: "Formatted at 2026-08-06 15:09:20 on dist-test-slave-tm1g"
server_key: "43b5083f8031bf6ebe088502a6aab72e"
server_key_iv: "7a20d4dfca3065b21bebb529b80fb5d9"
server_key_version: "kuduclusterkey@0"
I20260806 15:09:20.490253 9465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:09:20.506238 9465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:09:20.510973 9465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:09:20.511243 9465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:09:20.511596 9465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:09:20.512178 9465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:09:20.512285 9465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:20.512377 9465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:09:20.512555 9465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:09:20.530217 9465 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:39923
I20260806 15:09:20.530953 9465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:09:20.533932 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 9465
I20260806 15:09:20.534068 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:09:20.534334 29974 external_mini_cluster.cc:1428] Setting key 699f2215aa1b95449422af288c809d04
I20260806 15:09:20.539599 9597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:39923 every 8 connection(s)
Aug 06 15:09:20 dist-test-slave-tm1g krb5kdc[8603](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028960, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:09:20.559132 9316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.541599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:55451 (local address 127.29.69.190:46881)
0806 15:09:20.541641 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.541643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.542151 (+ 508us) server_negotiation.cc:407] Connection header received
0806 15:09:20.543124 (+ 973us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.543125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.543137 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.543167 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:09:20.544271 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.545195 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.547307 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.547682 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.547775 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.554743 (+ 6968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:09:20.554745 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:09:20.554745 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:09:20.554754 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:09:20.556963 (+ 2209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:20.557912 (+ 949us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:20.557914 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:20.557914 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:20.557996 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:20.558345 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:20.558346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:20.558347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:20.558504 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:09:20.558596 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.558937 (+ 341us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.559049 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:09:20.559362 9600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.541196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46881 (local address 127.29.69.131:55451)
0806 15:09:20.541998 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.542046 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.543001 (+ 955us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.543347 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.543351 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.543725 (+ 374us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:09:20.544134 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.544142 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.545353 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.545354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.547218 (+ 1864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.547221 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.548283 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.548284 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.548472 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.549200 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:09:20.549211 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:09:20.554623 (+ 5412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:09:20.557061 (+ 2438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:09:20.557069 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:09:20.557072 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:09:20.557494 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:09:20.558061 (+ 567us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:09:20.558062 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:09:20.558062 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:09:20.558211 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:09:20.558572 (+ 361us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:09:20.558579 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:09:20.558752 (+ 173us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.558865 (+ 113us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.559036 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":737,"thread_start_us":203,"threads_started":1}
I20260806 15:09:20.559855 9598 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46881
I20260806 15:09:20.559996 9598 heartbeater.cc:464] Registering TS with master...
I20260806 15:09:20.560217 9598 heartbeater.cc:511] Master 127.29.69.190:46881 requested a full tablet report, sending...
I20260806 15:09:20.560611 9097 ts_manager.cc:194] Registered new tserver with Master: 192c15d7fdb1483992e3c98f86a6a8a3 (127.29.69.131:39923)
I20260806 15:09:20.561158 9097 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:55451
I20260806 15:09:20.568605 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:09:20.583074 9316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.573339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48182 (local address 127.29.69.190:46881)
0806 15:09:20.573382 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.573384 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.573769 (+ 385us) server_negotiation.cc:407] Connection header received
0806 15:09:20.573881 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.573882 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.573893 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.573924 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:09:20.575016 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.575916 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.577247 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.577578 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.577633 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.579633 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:09:20.579634 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:09:20.579635 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:09:20.579642 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:09:20.581545 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:20.582023 (+ 478us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:20.582025 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:20.582026 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:20.582082 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:09:20.582343 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:09:20.582344 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:09:20.582344 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:09:20.582499 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:09:20.582588 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.582860 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.582954 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:09:20.585330 9097 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:09:20.588624 9097 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:09:20.598855 9612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.592819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:39923 (local address 127.0.0.1:59884)
0806 15:09:20.593724 (+ 905us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.593733 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.593769 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.594339 (+ 570us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.594342 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.594345 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:09:20.594410 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.594412 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.595909 (+ 1497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.595910 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.597206 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.597209 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.598575 (+ 1366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.598576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.598655 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.598667 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.598734 (+ 67us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.598782 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"thread_start_us":183,"threads_started":1}
I20260806 15:09:20.599097 9613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.593049 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59884 (local address 127.29.69.131:39923)
0806 15:09:20.593959 (+ 910us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.593964 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.593975 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:09:20.594045 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.594047 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.594064 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.594140 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:09:20.594498 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.595800 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.597435 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.598329 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.598400 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.598537 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.598980 (+ 443us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.599025 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":852,"thread_start_us":146,"threads_started":1}
I20260806 15:09:20.599845 9531 tablet_service.cc:1467] Processing CreateTablet for tablet 24f1614e402c454fb4b09d1ec15946a7 (DEFAULT_TABLE table=test-table [id=2ae0768b0d0d434bb27fe1837715e6f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:09:20.600370 9531 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f1614e402c454fb4b09d1ec15946a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:09:20.601130 9611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.592815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:36029 (local address 127.0.0.1:58534)
0806 15:09:20.593426 (+ 611us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.593468 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.593537 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.594799 (+ 1262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.594800 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.594802 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:09:20.594867 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.594868 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.597284 (+ 2416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.597285 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.599284 (+ 1999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.599287 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.600883 (+ 1596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.600884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.600956 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.600960 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.601016 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.601056 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":280,"threads_started":1}
I20260806 15:09:20.601950 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.593619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58534 (local address 127.29.69.130:36029)
0806 15:09:20.594508 (+ 889us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.594513 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.594535 (+ 22us) server_negotiation.cc:407] Connection header received
0806 15:09:20.594589 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.594591 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.594606 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.594696 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:09:20.595059 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.597084 (+ 2025us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.599428 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.600433 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.600615 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.600852 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.601701 (+ 849us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.601752 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":152,"threads_started":1}
I20260806 15:09:20.602779 9378 tablet_service.cc:1467] Processing CreateTablet for tablet 24f1614e402c454fb4b09d1ec15946a7 (DEFAULT_TABLE table=test-table [id=2ae0768b0d0d434bb27fe1837715e6f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:09:20.603184 9378 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f1614e402c454fb4b09d1ec15946a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:09:20.607752 9621 tablet_bootstrap.cc:492] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Bootstrap starting.
I20260806 15:09:20.608759 9616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.593263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:41805 (local address 127.0.0.1:40140)
0806 15:09:20.598427 (+ 5164us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.598439 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.598506 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.598777 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.598778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.598780 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:09:20.598823 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.598824 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.600327 (+ 1503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.600328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.601676 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.601679 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.608522 (+ 6843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.608523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.608588 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.608593 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.608646 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.608687 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5124,"thread_start_us":148,"threads_started":1}
I20260806 15:09:20.609056 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.593905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40140 (local address 127.29.69.129:41805)
0806 15:09:20.595019 (+ 1114us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.595024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.598569 (+ 3545us) server_negotiation.cc:407] Connection header received
0806 15:09:20.598609 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.598612 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.598629 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.598702 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:09:20.598900 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.600233 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.601762 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.608321 (+ 6559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.608399 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.608477 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.608925 (+ 448us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.608971 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1068,"thread_start_us":78,"threads_started":1}
I20260806 15:09:20.609881 9621 tablet_bootstrap.cc:654] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Neither blocks nor log segments found. Creating new log.
I20260806 15:09:20.609872 9232 tablet_service.cc:1467] Processing CreateTablet for tablet 24f1614e402c454fb4b09d1ec15946a7 (DEFAULT_TABLE table=test-table [id=2ae0768b0d0d434bb27fe1837715e6f2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:09:20.610203 9232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 24f1614e402c454fb4b09d1ec15946a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:09:20.610932 9621 log.cc:824] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:09:20.611696 9620 tablet_bootstrap.cc:492] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Bootstrap starting.
I20260806 15:09:20.613637 9620 tablet_bootstrap.cc:654] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Neither blocks nor log segments found. Creating new log.
I20260806 15:09:20.614636 9620 log.cc:824] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:09:20.614884 9623 tablet_bootstrap.cc:492] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec: Bootstrap starting.
I20260806 15:09:20.615758 9621 tablet_bootstrap.cc:492] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: No bootstrap required, opened a new log
I20260806 15:09:20.615869 9621 ts_tablet_manager.cc:1397] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Time spent bootstrapping tablet: real 0.008s user 0.000s sys 0.004s
I20260806 15:09:20.616425 9623 tablet_bootstrap.cc:654] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec: Neither blocks nor log segments found. Creating new log.
I20260806 15:09:20.617223 9623 log.cc:824] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec: Log is configured to *not* fsync() on all Append() calls
I20260806 15:09:20.618412 9623 tablet_bootstrap.cc:492] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec: No bootstrap required, opened a new log
I20260806 15:09:20.618491 9623 ts_tablet_manager.cc:1397] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260806 15:09:20.620306 9621 raft_consensus.cc:348] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.620527 9621 raft_consensus.cc:374] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:09:20.620570 9621 raft_consensus.cc:729] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f3247c0ce76464297a4599ab709f3d9, State: Initialized, Role: FOLLOWER
I20260806 15:09:20.620730 9621 consensus_queue.cc:260] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.621107 9621 ts_tablet_manager.cc:1428] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Time spent starting tablet: real 0.005s user 0.005s sys 0.001s
I20260806 15:09:20.621251 9459 heartbeater.cc:503] Master 127.29.69.190:46881 was elected leader, sending a full tablet report...
I20260806 15:09:20.622738 9623 raft_consensus.cc:348] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.622889 9623 raft_consensus.cc:374] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:09:20.622928 9623 raft_consensus.cc:729] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e466301046ec40bf8f6f35a4b4682cec, State: Initialized, Role: FOLLOWER
I20260806 15:09:20.623066 9623 consensus_queue.cc:260] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.623373 9623 ts_tablet_manager.cc:1428] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec: Time spent starting tablet: real 0.005s user 0.000s sys 0.005s
I20260806 15:09:20.623492 9314 heartbeater.cc:503] Master 127.29.69.190:46881 was elected leader, sending a full tablet report...
I20260806 15:09:20.624155 9620 tablet_bootstrap.cc:492] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: No bootstrap required, opened a new log
I20260806 15:09:20.624223 9620 ts_tablet_manager.cc:1397] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.000s
I20260806 15:09:20.628065 9620 raft_consensus.cc:348] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.628422 9620 raft_consensus.cc:374] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:09:20.628472 9620 raft_consensus.cc:729] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 192c15d7fdb1483992e3c98f86a6a8a3, State: Initialized, Role: FOLLOWER
I20260806 15:09:20.628594 9620 consensus_queue.cc:260] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.628827 9620 ts_tablet_manager.cc:1428] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20260806 15:09:20.628930 9598 heartbeater.cc:503] Master 127.29.69.190:46881 was elected leader, sending a full tablet report...
I20260806 15:09:20.628315 9626 raft_consensus.cc:482] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:09:20.629289 9626 raft_consensus.cc:504] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.631191 9626 leader_election.cc:288] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 192c15d7fdb1483992e3c98f86a6a8a3 (127.29.69.131:39923), e466301046ec40bf8f6f35a4b4682cec (127.29.69.129:41805)
I20260806 15:09:20.634254 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.630252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:39923 (local address 127.29.69.130:43557)
0806 15:09:20.630319 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.630330 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.630365 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.630996 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.630997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.630998 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:09:20.631161 (+ 163us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.631163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.632192 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.632193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.633275 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.633278 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.634027 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.634028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.634102 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.634105 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.634148 (+ 43us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.634187 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 15:09:20.634564 9613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.630790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:43557 (local address 127.29.69.131:39923)
0806 15:09:20.630865 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.630867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.630874 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:09:20.630896 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.630896 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.630906 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.630950 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:09:20.631233 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.631991 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.633411 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.633921 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.633985 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.633994 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.634468 (+ 474us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.634509 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 15:09:20.635017 9551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f1614e402c454fb4b09d1ec15946a7" candidate_uuid: "1f3247c0ce76464297a4599ab709f3d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" is_pre_election: true
I20260806 15:09:20.635136 9551 raft_consensus.cc:2454] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f3247c0ce76464297a4599ab709f3d9 in term 0.
I20260806 15:09:20.635427 9345 leader_election.cc:302] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c15d7fdb1483992e3c98f86a6a8a3, 1f3247c0ce76464297a4599ab709f3d9; no voters:
I20260806 15:09:20.635636 9626 raft_consensus.cc:2781] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:09:20.635792 9626 raft_consensus.cc:482] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:09:20.636000 9626 raft_consensus.cc:3037] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:09:20.637926 9626 raft_consensus.cc:504] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.638589 9551 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f1614e402c454fb4b09d1ec15946a7" candidate_uuid: "1f3247c0ce76464297a4599ab709f3d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "192c15d7fdb1483992e3c98f86a6a8a3"
I20260806 15:09:20.638660 9551 raft_consensus.cc:3037] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:09:20.638674 9626 leader_election.cc:288] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [CANDIDATE]: Term 1 election: Requested vote from peers 192c15d7fdb1483992e3c98f86a6a8a3 (127.29.69.131:39923), e466301046ec40bf8f6f35a4b4682cec (127.29.69.129:41805)
I20260806 15:09:20.639946 9551 raft_consensus.cc:2454] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f3247c0ce76464297a4599ab709f3d9 in term 1.
I20260806 15:09:20.640132 9345 leader_election.cc:302] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 192c15d7fdb1483992e3c98f86a6a8a3, 1f3247c0ce76464297a4599ab709f3d9; no voters:
I20260806 15:09:20.641501 9626 raft_consensus.cc:2781] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:09:20.641695 9626 raft_consensus.cc:686] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 1 LEADER]: Becoming Leader. State: Replica: 1f3247c0ce76464297a4599ab709f3d9, State: Running, Role: LEADER
I20260806 15:09:20.642192 9626 consensus_queue.cc:237] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } }
I20260806 15:09:20.643702 9097 catalog_manager.cc:5495] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1f3247c0ce76464297a4599ab709f3d9 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "1f3247c0ce76464297a4599ab709f3d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f3247c0ce76464297a4599ab709f3d9" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 36029 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 } health_report { overall_health: UNKNOWN } } }
I20260806 15:09:20.644088 9619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.630886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:40361 (local address 127.29.69.129:41805)
0806 15:09:20.630951 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.630954 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.630973 (+ 19us) server_negotiation.cc:407] Connection header received
0806 15:09:20.631007 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.631008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.631026 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.631129 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:09:20.632014 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.633224 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.640252 (+ 7028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.641303 (+ 1051us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.641392 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.641400 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.643903 (+ 2503us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.643977 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 15:09:20.644603 9629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.630377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:41805 (local address 127.29.69.130:40361)
0806 15:09:20.630703 (+ 326us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.630713 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:09:20.630759 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:09:20.631420 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:09:20.631421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:09:20.631434 (+ 13us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:09:20.631833 (+ 399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.631836 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.633422 (+ 1586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.633423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.639930 (+ 6507us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:09:20.639942 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.643633 (+ 3691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.643634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:09:20.643758 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.643762 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:09:20.644265 (+ 503us) client_negotiation.cc:240] Negotiation successful
0806 15:09:20.644349 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":185,"threads_started":1}
I20260806 15:09:20.645289 9256 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f1614e402c454fb4b09d1ec15946a7" candidate_uuid: "1f3247c0ce76464297a4599ab709f3d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e466301046ec40bf8f6f35a4b4682cec" is_pre_election: true
I20260806 15:09:20.645612 9256 raft_consensus.cc:2454] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1f3247c0ce76464297a4599ab709f3d9 in term 0.
I20260806 15:09:20.645856 9257 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "24f1614e402c454fb4b09d1ec15946a7" candidate_uuid: "1f3247c0ce76464297a4599ab709f3d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e466301046ec40bf8f6f35a4b4682cec"
I20260806 15:09:20.646004 9257 raft_consensus.cc:3037] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:09:20.647904 9257 raft_consensus.cc:2454] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1f3247c0ce76464297a4599ab709f3d9 in term 1.
I20260806 15:09:20.657697 9618 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.653096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58550 (local address 127.29.69.130:36029)
0806 15:09:20.653165 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0806 15:09:20.653167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:09:20.653175 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:09:20.653225 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:09:20.653226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:09:20.653253 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:09:20.653390 (+ 137us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:09:20.653534 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.654614 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.655872 (+ 1258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:09:20.656297 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:09:20.656407 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:09:20.656757 (+ 350us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:09:20.656980 (+ 223us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:09:20.657129 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0806 15:09:20.657524 (+ 395us) server_negotiation.cc:299] Negotiation successful
0806 15:09:20.657569 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:09:20.660812 9257 raft_consensus.cc:1261] T 24f1614e402c454fb4b09d1ec15946a7 P e466301046ec40bf8f6f35a4b4682cec [term 1 FOLLOWER]: Refusing update from remote peer 1f3247c0ce76464297a4599ab709f3d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:09:20.660986 9551 raft_consensus.cc:1261] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 1 FOLLOWER]: Refusing update from remote peer 1f3247c0ce76464297a4599ab709f3d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:09:20.661448 9626 consensus_queue.cc:1035] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "192c15d7fdb1483992e3c98f86a6a8a3" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:09:20.661700 9626 consensus_queue.cc:1035] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e466301046ec40bf8f6f35a4b4682cec" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 41805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:09:20.666596 9634 mvcc.cc:205] Tried to move back new op lower bound from 7315574622863515648 to 7315574622791675904. Current Snapshot: MvccSnapshot[applied={T|T < 7315574622863515648}]
I20260806 15:09:20.667903 9097 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:09:20.667997 9097 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:09:20.669059 9636 mvcc.cc:205] Tried to move back new op lower bound from 7315574622863515648 to 7315574622791675904. Current Snapshot: MvccSnapshot[applied={T|T < 7315574622863515648}]
I20260806 15:09:20.670857 9097 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1ef20731165b42e3b7ccea20a2291702: Sending DeleteTablet for 3 replicas of tablet 24f1614e402c454fb4b09d1ec15946a7
I20260806 15:09:20.671375 9232 tablet_service.cc:1514] Processing DeleteTablet for tablet 24f1614e402c454fb4b09d1ec15946a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:09:20 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:40140
I20260806 15:09:20.672281 9378 tablet_service.cc:1514] Processing DeleteTablet for tablet 24f1614e402c454fb4b09d1ec15946a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:09:20 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:58534
I20260806 15:09:20.672717 9531 tablet_service.cc:1514] Processing DeleteTablet for tablet 24f1614e402c454fb4b09d1ec15946a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:09:20 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:59884
I20260806 15:09:20.673187 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 9181
I20260806 15:09:20.676183 9644 tablet_replica.cc:330] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: stopping tablet replica
I20260806 15:09:20.676306 9644 raft_consensus.cc:2229] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:09:20.676376 9644 raft_consensus.cc:2258] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:09:20.676530 9643 tablet_replica.cc:330] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: stopping tablet replica
I20260806 15:09:20.676620 9643 raft_consensus.cc:2229] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:09:20.676703 9643 raft_consensus.cc:2258] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:09:20.677255 9643 ts_tablet_manager.cc:1905] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:09:20.679888 9643 ts_tablet_manager.cc:1918] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:09:20.679980 9643 log.cc:1196] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/24f1614e402c454fb4b09d1ec15946a7
I20260806 15:09:20.680276 9643 ts_tablet_manager.cc:1939] T 24f1614e402c454fb4b09d1ec15946a7 P 1f3247c0ce76464297a4599ab709f3d9: Deleting consensus metadata
I20260806 15:09:20.680742 9083 catalog_manager.cc:4841] TS 1f3247c0ce76464297a4599ab709f3d9 (127.29.69.130:36029): tablet 24f1614e402c454fb4b09d1ec15946a7 (table test-table [id=2ae0768b0d0d434bb27fe1837715e6f2]) successfully deleted
W20260806 15:09:20.682600 9081 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:41805 (error 108)
I20260806 15:09:20.683300 9644 ts_tablet_manager.cc:1905] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:09:20.683388 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 9323
I20260806 15:09:20.684934 9644 ts_tablet_manager.cc:1918] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:09:20.685004 9644 log.cc:1196] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/24f1614e402c454fb4b09d1ec15946a7
I20260806 15:09:20.685273 9644 ts_tablet_manager.cc:1939] T 24f1614e402c454fb4b09d1ec15946a7 P 192c15d7fdb1483992e3c98f86a6a8a3: Deleting consensus metadata
I20260806 15:09:20.686218 9082 catalog_manager.cc:4841] TS 192c15d7fdb1483992e3c98f86a6a8a3 (127.29.69.131:39923): tablet 24f1614e402c454fb4b09d1ec15946a7 (table test-table [id=2ae0768b0d0d434bb27fe1837715e6f2]) successfully deleted
I20260806 15:09:20.693832 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 9465
I20260806 15:09:20.695667 9616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:09:20.694803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:41805 (local address 127.0.0.1:40154)
0806 15:09:20.695573 (+ 770us) negotiation.cc:107] Waiting for socket to connect
0806 15:09:20.695626 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:41805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":747}
W20260806 15:09:20.695796 9081 catalog_manager.cc:4584] TS e466301046ec40bf8f6f35a4b4682cec (127.29.69.129:41805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 24f1614e402c454fb4b09d1ec15946a7: Network error: Client connection negotiation failed: client connection to 127.29.69.129:41805: connect: Connection refused (error 111)
I20260806 15:09:20.701495 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 9064
I20260806 15:09:20.708448 29974 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 15:09:21.053057 29974 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 15:09:21.053193 29974 mini_ranger.cc:66] Stopping Ranger...
I20260806 15:09:21.398001 29974 mini_ranger.cc:68] Stopped Ranger
2026-08-06 15:09:21.398 UTC [8634] LOG: received smart shutdown request
2026-08-06 15:09:21.401 UTC [8634] LOG: background worker "logical replication launcher" (PID 8643) exited with exit code 1
2026-08-06 15:09:21.401 UTC [8638] LOG: shutting down
2026-08-06 15:09:21.564 UTC [8634] LOG: database system is shut down
2026-08-06T15:09:21Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (47755 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:09:21 dist-test-slave-tm1g krb5kdc[9654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:09:21 dist-test-slave-tm1g krb5kdc[9654](info): set up 2 sockets
Aug 06 15:09:21 dist-test-slave-tm1g krb5kdc[9654](info): commencing operation
krb5kdc: starting...
W20260806 15:09:22.728698 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:09:22 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028962, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:09:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:09:22Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/rangeradmin_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/rangeradmin_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/rangerlookup_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/rangerlookup_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
I20260806 15:09:22.890676 29974 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJcRv5_/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/postgres -l logfile start
2026-08-06 15:09:25.309 UTC [9684] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-06 15:09:25.309 UTC [9684] LOG: listening on IPv4 address "127.29.69.148", port 45187
2026-08-06 15:09:25.313 UTC [9684] LOG: listening on Unix socket "/tmp/.s.PGSQL.45187"
2026-08-06 15:09:25.348 UTC [9688] LOG: database system was shut down at 2026-08-06 15:09:23 UTC
2026-08-06 15:09:25.352 UTC [9684] LOG: database system is ready to accept connections
I20260806 15:09:26.314366 29974 mini_postgres.cc:96] Postgres bound to 45187
2026-08-06 15:09:26.320 UTC [9696] FATAL: database "slave" does not exist
127.29.69.148:45187 - accepting connections
I20260806 15:09:26.321152 29974 mini_ranger.cc:161] Starting Ranger...
I20260806 15:09:26.335703 29974 mini_ranger.cc:84] Created miniranger Postgres user
I20260806 15:09:26.752451 29974 mini_ranger.cc:87] Created ranger Postgres database
I20260806 15:09:26.752528 29974 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-admin
2026-08-06 15:09:27,044 [I] DB FLAVOR :POSTGRES
2026-08-06 15:09:27,044 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 15:09:27,044 [I] Checking connection..
2026-08-06 15:09:27,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-06 15:09:27,272 [I] Checking connection passed.
2026-08-06 15:09:27,273 [I] --------- Verifying version history table ---------
2026-08-06 15:09:27,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 15:09:27,522 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 15:09:27,522 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 15:09:27,785 [I] Table x_db_version_h does not exist in database ranger
2026-08-06 15:09:27,785 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-06 15:09:27,785 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-06 15:09:28.041 UTC [9762] WARNING: there is no transaction in progress
2026-08-06 15:09:28,047 [I] create_dbversion_catalog.sql file imported successfully
2026-08-06 15:09:28,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-06 15:09:28,288 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-06 15:09:28,288 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 15:09:28,289 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-06 15:09:28,549 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-06 15:09:28,796 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-tm1g.c.gcp-upstream.internal','N') ;"
2026-08-06 15:09:29,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 15:09:29,291 [I] Table x_portal_user does not exist in database ranger
2026-08-06 15:09:29,291 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 15:09:29,537 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-06 15:09:29,537 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 15:09:29,790 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 15:09:30,035 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-06 15:09:30,035 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-06 15:09:30.958 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:30.973 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:30.989 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.003 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.018 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.038 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.090 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.097 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.112 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.124 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.135 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.153 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.162 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.168 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.174 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31.181 UTC [9873] WARNING: there is no transaction in progress
2026-08-06 15:09:31,780 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-06 15:09:31,781 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-06 15:09:32,034 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-06 15:09:32,034 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-06 15:09:32,278 [I] Table x_portal_user already exists in database 'ranger'
2026-08-06 15:09:32,279 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-06 15:09:32,541 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-06 15:09:32,541 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-06 15:09:32,772 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-06 15:09:33,015 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-tm1g.c.gcp-upstream.internal';"
2026-08-06 15:09:33,258 [I] CORE_DB_SCHEMA import status has been updated
2026-08-06 15:09:33,258 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-06 15:09:33,516 [I] DB_PATCHES have already been applied
I20260806 15:09:33.522656 29974 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJcRv5_/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260806 15:09:33.522722 29974 mini_ranger.cc:193] Using host: 127.29.69.148
I20260806 15:09:33.525936 29974 mini_ranger.cc:227] Ranger admin URL: http://127.29.69.148:43577
Aug 06, 2026 3:09:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 3:09:33 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 3:09:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp
Aug 06, 2026 3:09:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 06, 2026 3:09:33 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 06, 2026 3:09:34 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-admin/ews/webapp].
Aug 06, 2026 3:09:34 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260806 15:09:34.644886 29974 mini_ranger.cc:160] Time spent starting Ranger: real 8.324s user 0.000s sys 0.009s
Aug 06, 2026 3:09:56 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 06, 2026 3:09:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 06, 2026 3:09:56 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 06, 2026 3:09:56 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 06, 2026 3:09:57 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260806 15:09:58.018759 29974 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.29.69.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.29.69.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/rangerkms_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.29.69.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/rangerkms_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.29.69.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.29.69.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.29.69.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/HTTP_127.29.69.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 06 15:09:58 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028998, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260806 15:09:58.097916 29974 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260806 15:09:58.106961 29974 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260806 15:09:58.886765 29974 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260806 15:09:58.886873 29974 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms
I20260806 15:09:58.886893 29974 mini_ranger_kms.cc:227] Using postgres at 127.29.69.148:45187
2026-08-06 15:09:59,060 [I] DB FLAVOR :POSTGRES
2026-08-06 15:09:59,061 [I] --------- Verifying Ranger DB connection ---------
2026-08-06 15:09:59,061 [I] Checking connection
2026-08-06 15:09:59,061 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-06 15:09:59,306 [I] connection success
2026-08-06 15:09:59,307 [I] --------- Verifying Ranger DB tables ---------
2026-08-06 15:09:59,307 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-06 15:09:59,307 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-06 15:09:59,550 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-06 15:09:59,551 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-06 15:09:59,551 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-06 15:09:59,551 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.29.69.148:45187/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-06 15:09:59,807 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260806 15:10:00.316664 29974 mini_ranger_kms.cc:310] Created kms service
I20260806 15:10:00.517612 29974 mini_ranger_kms.cc:326] Created kudu user
I20260806 15:10:00.561785 29974 mini_ranger_kms.cc:343] Created rangerkms user
Aug 06 15:10:00 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786028998, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:01.006222 29974 mini_ranger_kms.cc:384] Added ranger policy
I20260806 15:10:01.006467 29974 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJcRv5_/build/release/bin/postgresql.jar:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJcRv5_/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260806 15:10:01.006493 29974 mini_ranger_kms.cc:240] Using host: 127.29.69.148
I20260806 15:10:01.010234 29974 mini_ranger_kms.cc:276] Ranger KMS PID: 10058
I20260806 15:10:01.010351 29974 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.29.69.148:32949
Aug 06, 2026 3:10:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 06, 2026 3:10:02 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 06, 2026 3:10:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 06, 2026 3:10:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 06, 2026 3:10:02 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-kms/ews/webapp].
Aug 06, 2026 3:10:02 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260806 15:10:03.302430 29974 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.205s user 0.000s sys 0.157s
I20260806 15:10:03.302538 29974 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260806 15:10:03.302603 29974 mini_ranger_kms.cc:401] 127.29.69.148:32949/kms/v1/keys
Aug 06 15:10:03 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786029003, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.69.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 06 15:10:03 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029003, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.69.148@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
Aug 06 15:10:04 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029003, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.29.69.148@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
Aug 06 15:10:06 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:10:06.373611 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36143
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:36143
--ranger_config_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:06.453653 10110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:06.453847 10110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:06.453869 10110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:06.455158 10110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:06.455202 10110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:06.455217 10110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:06.455229 10110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:06.455241 10110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:06.456823 10110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
--ranger_kms_url=127.29.69.148:32949/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:36143
--ranger_config_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:06.457077 10110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:06.457314 10110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:06.462128 10120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:06.462221 10110 server_base.cc:1034] running on GCE node
W20260806 15:10:06.462179 10118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:06.462142 10117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:06.462630 10110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:06.462932 10110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:06.464105 10110 hybrid_clock.cc:648] HybridClock initialized: now 1786029006464093 us; error 44 us; skew 500 ppm
Aug 06 15:10:06 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029006, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:06.470160 10110 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:06.470680 10110 webserver.cc:460] Webserver started at http://127.29.69.190:38757/ using document root <none> and password file <none>
I20260806 15:10:06.470916 10110 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:06.470976 10110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:06.471129 10110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:10:06 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029006, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:06.526064 10110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "aff3c4fca3c4452d86cccf18233ad78b"
format_stamp: "Formatted at 2026-08-06 15:10:06 on dist-test-slave-tm1g"
server_key: "7b00414f7416ffd4c4f23afb7d853975"
server_key_iv: "18862a03bf5593ad8fac1b5bc91334a7"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:06.526580 10110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "aff3c4fca3c4452d86cccf18233ad78b"
format_stamp: "Formatted at 2026-08-06 15:10:06 on dist-test-slave-tm1g"
server_key: "7b00414f7416ffd4c4f23afb7d853975"
server_key_iv: "18862a03bf5593ad8fac1b5bc91334a7"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:06.528386 10110 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260806 15:10:06.543450 10128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:06.543701 10110 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:06.543834 10110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "aff3c4fca3c4452d86cccf18233ad78b"
format_stamp: "Formatted at 2026-08-06 15:10:06 on dist-test-slave-tm1g"
server_key: "7b00414f7416ffd4c4f23afb7d853975"
server_key_iv: "18862a03bf5593ad8fac1b5bc91334a7"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:06.543933 10110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:06.578866 10110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:06.580735 10110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:06.580910 10110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:06.585300 10110 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:36143
I20260806 15:10:06.585355 10180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:36143 every 8 connection(s)
I20260806 15:10:06.585726 10110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:06.586473 10181 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:06.588686 10181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Bootstrap starting.
I20260806 15:10:06.589190 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10110
I20260806 15:10:06.589224 10181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:06.589313 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:10:06.589488 29974 external_mini_cluster.cc:1428] Setting key 512a6b655e3cd5feeed810d157af135f
I20260806 15:10:06.589591 10181 log.cc:824] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:06.590453 10181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: No bootstrap required, opened a new log
I20260806 15:10:06.592465 10181 raft_consensus.cc:348] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:06.592621 10181 raft_consensus.cc:374] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:06.592645 10181 raft_consensus.cc:729] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3c4fca3c4452d86cccf18233ad78b, State: Initialized, Role: FOLLOWER
I20260806 15:10:06.592794 10181 consensus_queue.cc:260] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:06.592876 10181 raft_consensus.cc:388] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:06.592911 10181 raft_consensus.cc:482] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:06.592957 10181 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:06.593621 10181 raft_consensus.cc:504] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:06.593713 10181 leader_election.cc:302] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aff3c4fca3c4452d86cccf18233ad78b; no voters:
I20260806 15:10:06.593904 10181 leader_election.cc:288] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:10:06.593964 10186 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:06.594127 10186 raft_consensus.cc:686] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 LEADER]: Becoming Leader. State: Replica: aff3c4fca3c4452d86cccf18233ad78b, State: Running, Role: LEADER
I20260806 15:10:06.594163 10181 sys_catalog.cc:564] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:06.594269 10186 consensus_queue.cc:237] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:06.594642 10187 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aff3c4fca3c4452d86cccf18233ad78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } } }
I20260806 15:10:06.594630 10186 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader aff3c4fca3c4452d86cccf18233ad78b. Latest consensus state: current_term: 1 leader_uuid: "aff3c4fca3c4452d86cccf18233ad78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } } }
I20260806 15:10:06.594799 10186 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:06.594792 10187 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:06.595089 10195 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:06.595674 10195 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:06.595978 10181 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 15:10:06.600993 10195 catalog_manager.cc:1347] Generated new cluster ID: a908863428564c7a96a3db4b4f394746
I20260806 15:10:06.601208 10195 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:10:06 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:06.607255 10185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:06.590081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59994 (local address 127.29.69.190:36143)
0806 15:10:06.590239 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:06.590249 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:06.592856 (+ 2607us) server_negotiation.cc:407] Connection header received
0806 15:10:06.593015 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:06.593023 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:06.593089 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:06.593233 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:06.593897 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:06.595515 (+ 1618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:06.597812 (+ 2297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:06.599644 (+ 1832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:06.601068 (+ 1424us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:06.602847 (+ 1779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:06.602852 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:06.602852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:06.602864 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:06.605045 (+ 2181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:06.605500 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:06.605502 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:06.605503 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:06.605638 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:06.605867 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:06.605867 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:06.605868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:06.606180 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:06.606830 (+ 650us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:06.606904 (+ 74us) server_negotiation.cc:299] Negotiation successful
0806 15:10:06.607040 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":75,"threads_started":1}
I20260806 15:10:06.613763 10195 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:10:06.614506 10195 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:06.625046 10195 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Generated new TSK 0
I20260806 15:10:06.625247 10195 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:10:07.337316 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36143
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:07.449066 10227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:07.449326 10227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:07.449360 10227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:07.451045 10227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:07.451176 10227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:07.451237 10227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:07.452904 10227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.29.69.148:32949/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:07.453142 10227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:07.453382 10227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:07.459532 10233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:07.459741 10232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:07.459558 10235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:07.459862 10227 server_base.cc:1034] running on GCE node
I20260806 15:10:07.460062 10227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:07.460331 10227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:07.461488 10227 hybrid_clock.cc:648] HybridClock initialized: now 1786029007461466 us; error 37 us; skew 500 ppm
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:07.463994 10227 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:07.464498 10227 webserver.cc:460] Webserver started at http://127.29.69.129:33469/ using document root <none> and password file <none>
I20260806 15:10:07.464756 10227 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:07.464802 10227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:07.464924 10227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:07.479176 10227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "bbb094368312459198988e06db28b138"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "378434e5a6308b1ffe0f974a23d55b36"
server_key_iv: "a50d32fb17d8144dc4d06ed81a7909e1"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:07.479763 10227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "bbb094368312459198988e06db28b138"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "378434e5a6308b1ffe0f974a23d55b36"
server_key_iv: "a50d32fb17d8144dc4d06ed81a7909e1"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:07.481794 10227 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:07.497627 10244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:07.497886 10227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:07.498009 10227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "bbb094368312459198988e06db28b138"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "378434e5a6308b1ffe0f974a23d55b36"
server_key_iv: "a50d32fb17d8144dc4d06ed81a7909e1"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:07.498106 10227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:07.514978 10227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:07.517545 10227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:07.517731 10227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:07.518078 10227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:07.518566 10227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:07.518682 10227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:07.518791 10227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:07.518875 10227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:07.525650 10227 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:33659
I20260806 15:10:07.526149 10227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:10:07.533906 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10227
I20260806 15:10:07.534008 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:10:07.534215 29974 external_mini_cluster.cc:1428] Setting key 1dae1ecf8c1aa135d425bd6009ff711c
I20260806 15:10:07.536305 10360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:33659 every 8 connection(s)
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:07.545929 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:07.527612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:33539 (local address 127.29.69.190:36143)
0806 15:10:07.535727 (+ 8115us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:07.535729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:07.535737 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:07.535762 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:07.535763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:07.535775 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:07.535839 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:07.536634 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.537454 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.539039 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.539352 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.539408 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:07.542227 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:07.542229 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:07.542229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:07.542238 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:07.544205 (+ 1967us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:07.544726 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:07.544727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:07.544727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:07.544798 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:07.545111 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:07.545112 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:07.545113 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:07.545259 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:07.545305 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:07.545727 (+ 422us) server_negotiation.cc:299] Negotiation successful
0806 15:10:07.545825 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8084,"thread_start_us":87,"threads_started":1}
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
I20260806 15:10:07.546777 10363 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:07.527278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36143 (local address 127.29.69.129:33539)
0806 15:10:07.534692 (+ 7414us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:07.534744 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:07.535388 (+ 644us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:07.535967 (+ 579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:07.535971 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:07.536238 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:07.536516 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:07.536522 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.537573 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.537583 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:07.538926 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:07.538929 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.539523 (+ 594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.539524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:07.539687 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:07.540406 (+ 719us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:07.540418 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:07.542112 (+ 1694us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:07.544306 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:07.544313 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:07.544316 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:07.544625 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:07.544877 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:07.544878 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:07.544878 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:07.545014 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:07.545381 (+ 367us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:07.545388 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:07.545553 (+ 165us) client_negotiation.cc:769] Sending connection context
0806 15:10:07.546294 (+ 741us) client_negotiation.cc:240] Negotiation successful
0806 15:10:07.546497 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7360,"thread_start_us":93,"threads_started":1}
I20260806 15:10:07.547628 10361 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36143
I20260806 15:10:07.547732 10361 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:07.547935 10361 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:07.548544 10145 ts_manager.cc:194] Registered new tserver with Master: bbb094368312459198988e06db28b138 (127.29.69.129:33659)
I20260806 15:10:07.549422 10145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:33539
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:10:07.583354 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36143
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:07.708700 10367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:07.709062 10367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:07.709161 10367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:07.710955 10367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:07.711179 10367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:07.711287 10367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:07.714032 10367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.29.69.148:32949/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:07.714540 10367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:07.714877 10367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:07.721884 10374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:07.722245 10377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:07.722496 10375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:07.723071 10367 server_base.cc:1034] running on GCE node
I20260806 15:10:07.723390 10367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:07.723660 10367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:07.724828 10367 hybrid_clock.cc:648] HybridClock initialized: now 1786029007724805 us; error 36 us; skew 500 ppm
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:07.728472 10367 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:07.728976 10367 webserver.cc:460] Webserver started at http://127.29.69.130:44537/ using document root <none> and password file <none>
I20260806 15:10:07.729218 10367 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:07.729266 10367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:07.729421 10367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:07.751832 10367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "c018831b4d734fcfaff485b650c5fc1e"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "e23539eb852fa5c4a8d4dbe3e2562776"
server_key_iv: "b9d0f77c4d424327d6f9e85cc62774dc"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:07.752408 10367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "c018831b4d734fcfaff485b650c5fc1e"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "e23539eb852fa5c4a8d4dbe3e2562776"
server_key_iv: "b9d0f77c4d424327d6f9e85cc62774dc"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:07.756426 10367 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260806 15:10:07.773505 10384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:07.773743 10367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:07.773845 10367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "c018831b4d734fcfaff485b650c5fc1e"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "e23539eb852fa5c4a8d4dbe3e2562776"
server_key_iv: "b9d0f77c4d424327d6f9e85cc62774dc"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:07.773931 10367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:07.789899 10367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:07.792058 10367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:07.792213 10367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:07.792424 10367 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:07.792752 10367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:07.792809 10367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:07.792876 10367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:07.792927 10367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:07.799445 10367 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:46039
I20260806 15:10:07.799916 10367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:10:07.802083 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10367
I20260806 15:10:07.802173 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:10:07.802389 29974 external_mini_cluster.cc:1428] Setting key c81f13c1af058fee82fef1c9c87c0d5c
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
I20260806 15:10:07.816843 10501 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:46039 every 8 connection(s)
Aug 06 15:10:07 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029007, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:07.844187 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:07.817767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:49095 (local address 127.29.69.190:36143)
0806 15:10:07.817815 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:07.817818 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:07.822469 (+ 4651us) server_negotiation.cc:407] Connection header received
0806 15:10:07.825521 (+ 3052us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:07.825522 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:07.825542 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:07.825577 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:07.826472 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.827299 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.830390 (+ 3091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.830731 (+ 341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.830776 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:07.838276 (+ 7500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:07.838278 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:07.838278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:07.838287 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:07.840076 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:07.843055 (+ 2979us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:07.843056 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:07.843056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:07.843122 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:07.843398 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:07.843399 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:07.843399 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:07.843545 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:07.843601 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:07.843976 (+ 375us) server_negotiation.cc:299] Negotiation successful
0806 15:10:07.844076 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:10:07.845871 10507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:07.817487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36143 (local address 127.29.69.130:49095)
0806 15:10:07.822014 (+ 4527us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:07.822365 (+ 351us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:07.823068 (+ 703us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:07.825785 (+ 2717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:07.825789 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:07.826048 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:07.826355 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:07.826362 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.827418 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.827419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:07.828714 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:07.828716 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:07.830882 (+ 2166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:07.830883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:07.831046 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:07.833240 (+ 2194us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:07.833251 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:07.835034 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:07.842614 (+ 7580us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:07.842622 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:07.842625 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:07.842937 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:07.843192 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:07.843192 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:07.843193 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:07.843325 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:07.843635 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:07.843641 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:07.843809 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 15:10:07.844699 (+ 890us) client_negotiation.cc:240] Negotiation successful
0806 15:10:07.845625 (+ 926us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4477,"thread_start_us":79,"threads_started":1}
I20260806 15:10:07.846660 10502 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36143
I20260806 15:10:07.846760 10502 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:07.846952 10502 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:07.847420 10145 ts_manager.cc:194] Registered new tserver with Master: c018831b4d734fcfaff485b650c5fc1e (127.29.69.130:46039)
I20260806 15:10:07.847929 10145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:49095
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:10:07.857453 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36143
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:08.011656 10508 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:08.011910 10508 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:08.011953 10508 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:08.013401 10508 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:08.013465 10508 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:08.013513 10508 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:08.015441 10508 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.29.69.148:32949/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:08.015723 10508 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:08.015982 10508 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:08.023051 10516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.023411 10513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.023651 10514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:08.024013 10508 server_base.cc:1034] running on GCE node
I20260806 15:10:08.024243 10508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:08.024582 10508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:08.027879 10508 hybrid_clock.cc:648] HybridClock initialized: now 1786029008027831 us; error 42 us; skew 500 ppm
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:08.031438 10508 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:08.032220 10508 webserver.cc:460] Webserver started at http://127.29.69.131:35797/ using document root <none> and password file <none>
I20260806 15:10:08.032620 10508 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:08.032684 10508 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:08.032814 10508 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:08.052022 10508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "d55dab8ff375494fbe87f8434de2027f"
format_stamp: "Formatted at 2026-08-06 15:10:08 on dist-test-slave-tm1g"
server_key: "64859be4fb408c979ce8d7fa26ae40b5"
server_key_iv: "62e26701743ab2fb337059a7719a1c24"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.052446 10508 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "d55dab8ff375494fbe87f8434de2027f"
format_stamp: "Formatted at 2026-08-06 15:10:08 on dist-test-slave-tm1g"
server_key: "64859be4fb408c979ce8d7fa26ae40b5"
server_key_iv: "62e26701743ab2fb337059a7719a1c24"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.058914 10508 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.001s
I20260806 15:10:08.078419 10523 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.082477 10508 fs_manager.cc:725] Time spent opening block manager: real 0.011s user 0.001s sys 0.000s
I20260806 15:10:08.082602 10508 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "d55dab8ff375494fbe87f8434de2027f"
format_stamp: "Formatted at 2026-08-06 15:10:08 on dist-test-slave-tm1g"
server_key: "64859be4fb408c979ce8d7fa26ae40b5"
server_key_iv: "62e26701743ab2fb337059a7719a1c24"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.082702 10508 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:08.103830 10508 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:08.106777 10508 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:08.106981 10508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:08.107329 10508 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:08.107779 10508 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:08.107836 10508 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.107920 10508 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:08.107965 10508 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.116245 10508 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:43295
I20260806 15:10:08.116647 10508 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:10:08.117314 10639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:43295 every 8 connection(s)
I20260806 15:10:08.124763 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10508
I20260806 15:10:08.124879 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:10:08.125056 29974 external_mini_cluster.cc:1428] Setting key 4eafb1ced16aa6bdb6c2fdd00c846a9f
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:08.134356 10364 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.117758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:55821 (local address 127.29.69.190:36143)
0806 15:10:08.117801 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:08.117803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:08.117814 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:10:08.118360 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:08.118362 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:08.118376 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:08.118425 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:08.126959 (+ 8534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.127490 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.128588 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.128812 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.128901 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.131188 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:08.131190 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:08.131190 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:08.131198 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:08.132757 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.133196 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.133198 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.133198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.133270 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.133534 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.133535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.133535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.133671 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:08.133746 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:08.134115 (+ 369us) server_negotiation.cc:299] Negotiation successful
0806 15:10:08.134223 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:10:08.135325 10642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.117445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36143 (local address 127.29.69.131:55821)
0806 15:10:08.117612 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:08.117655 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:08.118220 (+ 565us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:08.126260 (+ 8040us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:08.126266 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:08.126559 (+ 293us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:08.126841 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.126847 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.127602 (+ 755us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.127604 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.128491 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.128493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.128928 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.128929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.129055 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.129640 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:08.129649 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:08.131082 (+ 1433us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:08.132861 (+ 1779us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.132869 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.132872 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.133114 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.133349 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.133350 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.133350 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.133467 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.133748 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:08.133756 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:08.133924 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 15:10:08.134905 (+ 981us) client_negotiation.cc:240] Negotiation successful
0806 15:10:08.135088 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260806 15:10:08.136025 10640 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36143
I20260806 15:10:08.136201 10640 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.136912 10640 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:08.137346 10145 ts_manager.cc:194] Registered new tserver with Master: d55dab8ff375494fbe87f8434de2027f (127.29.69.131:43295)
I20260806 15:10:08.137840 10145 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:55821
I20260806 15:10:08.147578 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:10:08.148340 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10227
I20260806 15:10:08.161605 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10367
I20260806 15:10:08.169494 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10508
I20260806 15:10:08.177137 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10110
I20260806 15:10:08.184170 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36143
--webserver_interface=127.29.69.190
--webserver_port=38757
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:36143
--ranger_config_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:08.266604 10643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:08.266808 10643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:08.266829 10643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:08.267971 10643 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:08.268013 10643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:08.268028 10643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:08.268039 10643 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:08.268088 10643 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:08.269676 10643 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:36143
--ranger_config_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=38757
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:08.269919 10643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:08.270154 10643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:08.275643 10648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.275641 10649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:08.275840 10643 server_base.cc:1034] running on GCE node
W20260806 15:10:08.275641 10651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:08.276134 10643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:08.276463 10643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:08.277621 10643 hybrid_clock.cc:648] HybridClock initialized: now 1786029008277602 us; error 37 us; skew 500 ppm
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:08.280155 10643 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:08.280591 10643 webserver.cc:460] Webserver started at http://127.29.69.190:38757/ using document root <none> and password file <none>
I20260806 15:10:08.280823 10643 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:08.280900 10643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:08.324355 10643 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:08.325176 10659 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.325378 10643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:08.325503 10643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "aff3c4fca3c4452d86cccf18233ad78b"
format_stamp: "Formatted at 2026-08-06 15:10:06 on dist-test-slave-tm1g"
server_key: "7b00414f7416ffd4c4f23afb7d853975"
server_key_iv: "18862a03bf5593ad8fac1b5bc91334a7"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.325889 10643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:08.338801 10643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:08.340405 10643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:08.340579 10643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:08.345021 10643 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:36143
I20260806 15:10:08.345062 10715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:36143 every 8 connection(s)
I20260806 15:10:08.345520 10643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:08.346874 10716 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:10:08.347600 10716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Bootstrap starting.
I20260806 15:10:08.349956 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10643
I20260806 15:10:08.350267 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:33659
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:36143
--webserver_port=33469
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:08.356329 10716 log.cc:824] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:08.358367 10716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:08.358678 10716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Bootstrap complete.
I20260806 15:10:08.361168 10716 raft_consensus.cc:348] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:08.361438 10716 raft_consensus.cc:729] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aff3c4fca3c4452d86cccf18233ad78b, State: Initialized, Role: FOLLOWER
I20260806 15:10:08.361661 10716 consensus_queue.cc:260] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:08.361763 10716 raft_consensus.cc:388] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:08.361820 10716 raft_consensus.cc:482] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:08.361869 10716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:10:08.363013 10716 raft_consensus.cc:504] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:08.363144 10716 leader_election.cc:302] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aff3c4fca3c4452d86cccf18233ad78b; no voters:
I20260806 15:10:08.363358 10716 leader_election.cc:288] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 15:10:08.363395 10720 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:10:08.363513 10720 raft_consensus.cc:686] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [term 2 LEADER]: Becoming Leader. State: Replica: aff3c4fca3c4452d86cccf18233ad78b, State: Running, Role: LEADER
I20260806 15:10:08.363668 10716 sys_catalog.cc:564] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:08.363690 10720 consensus_queue.cc:237] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } }
I20260806 15:10:08.364087 10722 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: SysCatalogTable state changed. Reason: New leader aff3c4fca3c4452d86cccf18233ad78b. Latest consensus state: current_term: 2 leader_uuid: "aff3c4fca3c4452d86cccf18233ad78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } } }
I20260806 15:10:08.364174 10722 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:08.364579 10721 sys_catalog.cc:455] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "aff3c4fca3c4452d86cccf18233ad78b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aff3c4fca3c4452d86cccf18233ad78b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36143 } } }
I20260806 15:10:08.364655 10721 sys_catalog.cc:458] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:08.365355 10716 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260806 15:10:08.365697 10726 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:08.368942 10726 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:08.369315 10726 catalog_manager.cc:1259] Loaded cluster ID: a908863428564c7a96a3db4b4f394746
I20260806 15:10:08.369432 10726 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:08.371143 10726 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:08.371388 10726 catalog_manager.cc:5879] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Loaded TSK: 0
I20260806 15:10:08.371688 10726 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:10:08.463109 10718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:08.463379 10718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:08.463433 10718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:08.465145 10718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:08.465207 10718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:08.465248 10718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:08.467455 10718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:33659
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=33469
--tserver_master_addrs=127.29.69.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:08.467682 10718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:08.467970 10718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:08.474632 10756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.474694 10753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.474838 10754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:08.475747 10718 server_base.cc:1034] running on GCE node
I20260806 15:10:08.476024 10718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:08.476298 10718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:08.479571 10718 hybrid_clock.cc:648] HybridClock initialized: now 1786029008479535 us; error 47 us; skew 500 ppm
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:08.482861 10718 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:08.483377 10718 webserver.cc:460] Webserver started at http://127.29.69.129:33469/ using document root <none> and password file <none>
I20260806 15:10:08.483688 10718 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:08.483790 10718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:08.514763 10718 fs_manager.cc:709] Time spent opening directory manager: real 0.009s user 0.000s sys 0.001s
I20260806 15:10:08.515496 10764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.515690 10718 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:08.515780 10718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "bbb094368312459198988e06db28b138"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "378434e5a6308b1ffe0f974a23d55b36"
server_key_iv: "a50d32fb17d8144dc4d06ed81a7909e1"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.516975 10718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:08.543267 10718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:08.545768 10718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:08.545972 10718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:08.546218 10718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:08.546651 10718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:08.546736 10718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.546833 10718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:08.546904 10718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.553032 10718 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:33659
I20260806 15:10:08.553530 10718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:10:08.562947 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10718
I20260806 15:10:08.563241 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:46039
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:36143
--webserver_port=44537
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:08.556257 10880 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:33659 every 8 connection(s)
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:08.577325 10883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.556842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36143 (local address 127.29.69.129:33541)
0806 15:10:08.562451 (+ 5609us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:08.562501 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:08.565443 (+ 2942us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:08.566098 (+ 655us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:08.566102 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:08.566398 (+ 296us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:08.566714 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.566721 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.568187 (+ 1466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.568188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.569288 (+ 1100us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.569291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.570200 (+ 909us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.570201 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.570351 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.570980 (+ 629us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:08.570991 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:08.572767 (+ 1776us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:08.575198 (+ 2431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.575206 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.575208 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.575543 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.575863 (+ 320us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.575864 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.575864 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.576022 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.576554 (+ 532us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:08.576562 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:08.576731 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 15:10:08.576838 (+ 107us) client_negotiation.cc:240] Negotiation successful
0806 15:10:08.577031 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5560,"thread_start_us":101,"threads_started":1}
I20260806 15:10:08.578226 10884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.556918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:33541 (local address 127.29.69.190:36143)
0806 15:10:08.557127 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:08.557137 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:08.564978 (+ 7841us) server_negotiation.cc:407] Connection header received
0806 15:10:08.565730 (+ 752us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:08.565736 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:08.565795 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:08.565918 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:08.566851 (+ 933us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.568066 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.569398 (+ 1332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.569975 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.570080 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.572902 (+ 2822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:08.572907 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:08.572907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:08.572919 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:08.575095 (+ 2176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.575654 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.575657 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.575658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.575780 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.576108 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.576109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.576109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.576432 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:08.576519 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:08.577823 (+ 1304us) server_negotiation.cc:299] Negotiation successful
0806 15:10:08.577975 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260806 15:10:08.579304 10881 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36143
I20260806 15:10:08.579434 10881 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.579622 10881 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
W20260806 15:10:08.580533 10881 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:36143 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 15:10:08.580616 10881 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.580687 10881 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:08.581053 10881 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.581133 10881 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
W20260806 15:10:08.581442 10881 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:10:08.672428 10885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:08.672654 10885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:08.672695 10885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:08.673875 10885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:08.673957 10885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:08.674000 10885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:10:08.676092 10885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:46039
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=44537
--tserver_master_addrs=127.29.69.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:08.676354 10885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:08.676594 10885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:08.682262 10891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.682281 10892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.682412 10894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:08.683450 10885 server_base.cc:1034] running on GCE node
I20260806 15:10:08.683666 10885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:08.683935 10885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:08.685104 10885 hybrid_clock.cc:648] HybridClock initialized: now 1786029008685083 us; error 36 us; skew 500 ppm
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:08.688326 10885 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:08.688941 10885 webserver.cc:460] Webserver started at http://127.29.69.130:44537/ using document root <none> and password file <none>
I20260806 15:10:08.689256 10885 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:08.689386 10885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:08.708992 10885 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:08.712059 10902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.712285 10885 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.000s
I20260806 15:10:08.712383 10885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "c018831b4d734fcfaff485b650c5fc1e"
format_stamp: "Formatted at 2026-08-06 15:10:07 on dist-test-slave-tm1g"
server_key: "e23539eb852fa5c4a8d4dbe3e2562776"
server_key_iv: "b9d0f77c4d424327d6f9e85cc62774dc"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.712801 10885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:08.731813 10885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:08.733950 10885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:08.734123 10885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:08.734454 10885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:08.734790 10885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:08.734848 10885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.734884 10885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:08.734911 10885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.742126 10885 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:46039
I20260806 15:10:08.742204 11016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:46039 every 8 connection(s)
I20260806 15:10:08.742617 10885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:10:08.745882 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 10885
I20260806 15:10:08.746160 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.29.69.148:32949/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:43295
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:36143
--webserver_port=35797
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42539
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:08.754045 11019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.743434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36143 (local address 127.29.69.130:54211)
0806 15:10:08.743642 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:08.743692 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:08.744389 (+ 697us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:08.744700 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:08.744703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:08.744926 (+ 223us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:08.745193 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.745199 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.746281 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.746283 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.747619 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.747622 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.748237 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.748238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.748391 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.749025 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:08.749036 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:08.750525 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:08.752420 (+ 1895us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.752426 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.752427 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.752667 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.752926 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.752927 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.752927 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.753037 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.753519 (+ 482us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:08.753526 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:08.753655 (+ 129us) client_negotiation.cc:769] Sending connection context
0806 15:10:08.753758 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 15:10:08.753877 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":96,"threads_started":1}
I20260806 15:10:08.754053 10884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.743745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:54211 (local address 127.29.69.190:36143)
0806 15:10:08.743810 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:08.743812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:08.743823 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:10:08.744538 (+ 715us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:08.744540 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:08.744558 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:08.744631 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:08.745308 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.746157 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.747732 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.748050 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.748112 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.750618 (+ 2506us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:08.750620 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:08.750620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:08.750628 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:08.752328 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.752744 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.752746 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.752746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.752815 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.753205 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.753206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.753206 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.753369 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:08.753455 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:08.753807 (+ 352us) server_negotiation.cc:299] Negotiation successful
0806 15:10:08.753915 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 15:10:08.754729 11017 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36143
I20260806 15:10:08.754885 11017 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.755136 11017 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
W20260806 15:10:08.755985 11017 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:36143 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 15:10:08.756130 11017 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.756242 11017 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:08.756718 11017 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.756848 11017 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
W20260806 15:10:08.757310 11017 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:10:08.855659 11020 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:08.856010 11020 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:08.856091 11020 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:08.857996 11020 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:08.858085 11020 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:08.858142 11020 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:08.860299 11020 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42539
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.29.69.148:32949/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:43295
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=35797
--tserver_master_addrs=127.29.69.190:36143
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11020
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:08.860680 11020 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:08.861001 11020 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:08.867442 11027 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.867434 11029 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:08.870396 11026 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:08.870751 11020 server_base.cc:1034] running on GCE node
I20260806 15:10:08.870985 11020 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:08.871285 11020 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:08.872481 11020 hybrid_clock.cc:648] HybridClock initialized: now 1786029008872447 us; error 46 us; skew 500 ppm
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:08.875787 11020 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:08.876348 11020 webserver.cc:460] Webserver started at http://127.29.69.131:35797/ using document root <none> and password file <none>
I20260806 15:10:08.876668 11020 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:08.876760 11020 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:08.892053 11020 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:08.893187 11037 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.893393 11020 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:08.893491 11020 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "d55dab8ff375494fbe87f8434de2027f"
format_stamp: "Formatted at 2026-08-06 15:10:08 on dist-test-slave-tm1g"
server_key: "64859be4fb408c979ce8d7fa26ae40b5"
server_key_iv: "62e26701743ab2fb337059a7719a1c24"
server_key_version: "kuduclusterkey@0"
I20260806 15:10:08.893978 11020 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:08.934540 11020 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:08.939546 11020 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:08.939733 11020 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:08.940006 11020 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:08.940408 11020 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:08.940448 11020 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.940480 11020 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:08.940498 11020 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:08.947104 11020 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:43295
I20260806 15:10:08.947463 11151 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:43295 every 8 connection(s)
I20260806 15:10:08.947592 11020 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:10:08.955969 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11020
Aug 06 15:10:08 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029008, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:08.960261 11154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.948404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36143 (local address 127.29.69.131:41773)
0806 15:10:08.948598 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:08.948646 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:08.949259 (+ 613us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:08.949628 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:08.949632 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:08.949864 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:08.950150 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.950157 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.951222 (+ 1065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.951223 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.952509 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:08.952512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.953044 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.953045 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:08.953199 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.953788 (+ 589us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:08.953798 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:08.956497 (+ 2699us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:08.958498 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.958504 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.958507 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.958796 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.959065 (+ 269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:08.959066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:08.959066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:08.959222 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:08.959546 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:08.959554 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:08.959720 (+ 166us) client_negotiation.cc:769] Sending connection context
0806 15:10:08.959839 (+ 119us) client_negotiation.cc:240] Negotiation successful
0806 15:10:08.960007 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260806 15:10:08.960740 10884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.948713 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:41773 (local address 127.29.69.190:36143)
0806 15:10:08.948763 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:08.948765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:08.948777 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:10:08.949399 (+ 622us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:08.949401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:08.949414 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:08.949445 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:08.950271 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.951113 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.952616 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.952919 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.953009 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.956625 (+ 3616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:08.956627 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:08.956627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:08.956634 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:08.958409 (+ 1775us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.958907 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.958909 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.958909 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.958978 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.959309 (+ 331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.959310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.959311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.959449 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:08.959516 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:08.960558 (+ 1042us) server_negotiation.cc:299] Negotiation successful
0806 15:10:08.960647 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:10:08.961081 11152 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36143
I20260806 15:10:08.961192 11152 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.961390 11152 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
W20260806 15:10:08.962074 11152 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:36143 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260806 15:10:08.962155 11152 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.962215 11152 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:08.962597 11152 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:08.962685 11152 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
W20260806 15:10:08.963027 11152 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 15:10:08.971032 11156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:08.956637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47850 (local address 127.29.69.190:36143)
0806 15:10:08.957498 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:08.957500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:08.957508 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:08.957528 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:08.957529 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:08.957541 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:08.957598 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:08.959596 (+ 1998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.960640 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.963380 (+ 2740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:08.963660 (+ 280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:08.963733 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:08.965304 (+ 1571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:08.965306 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:08.965306 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:08.965313 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:08.967070 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.968050 (+ 980us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.968051 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.968051 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.968118 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:08.968363 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:08.968364 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:08.968364 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:08.968501 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:08.968660 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:08.970858 (+ 2198us) server_negotiation.cc:299] Negotiation successful
0806 15:10:08.970953 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":840,"thread_start_us":61,"threads_started":1}
Aug 06 15:10:09 dist-test-slave-tm1g krb5kdc[9654](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786029009, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:09.581635 10881 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:09.581807 10881 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:09.582231 10677 ts_manager.cc:194] Registered new tserver with Master: bbb094368312459198988e06db28b138 (127.29.69.129:33659)
I20260806 15:10:09.583292 10677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:33541
I20260806 15:10:09.757565 11017 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:09.757714 11017 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:09.758008 10677 ts_manager.cc:194] Registered new tserver with Master: c018831b4d734fcfaff485b650c5fc1e (127.29.69.130:46039)
I20260806 15:10:09.758599 10677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:54211
Aug 06 15:10:09 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029009, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:09.963199 11152 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:09.963377 11152 heartbeater.cc:511] Master 127.29.69.190:36143 requested a full tablet report, sending...
I20260806 15:10:09.963713 10677 ts_manager.cc:194] Registered new tserver with Master: d55dab8ff375494fbe87f8434de2027f (127.29.69.131:43295)
I20260806 15:10:09.964160 10677 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:41773
I20260806 15:10:09.965797 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:10:09.973552 11174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.966814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47866 (local address 127.29.69.190:36143)
0806 15:10:09.966944 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:09.966946 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:09.967015 (+ 69us) server_negotiation.cc:407] Connection header received
0806 15:10:09.967084 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:09.967085 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:09.967097 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:09.967160 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:09.967731 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.968239 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.968997 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.969224 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.969313 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.970684 (+ 1371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:09.970685 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:09.970686 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:09.970693 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:09.972276 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:09.972648 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:09.972649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:09.972649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:09.972717 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:09.972935 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:09.972936 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:09.972936 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:09.973054 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:09.973165 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:09.973263 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 15:10:09.973354 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":69,"threads_started":1}
I20260806 15:10:09.975550 10677 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47866:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:10:09.977420 10677 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:10:09.984319 11183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.980542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48144 (local address 127.29.69.130:46039)
0806 15:10:09.980953 (+ 411us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:09.980958 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:09.980980 (+ 22us) server_negotiation.cc:407] Connection header received
0806 15:10:09.981016 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:09.981018 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:09.981035 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:09.981110 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:09.981346 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.982031 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.983288 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.983882 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.983975 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.984042 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:09.984197 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 15:10:09.984244 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":58,"threads_started":1}
I20260806 15:10:09.984313 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.980251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:46039 (local address 127.0.0.1:48144)
0806 15:10:09.980693 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:09.980738 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:09.980790 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:09.981211 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:09.981213 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:09.981215 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:09.981266 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:09.981267 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.982120 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.982121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:09.983204 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:09.983206 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.983980 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.983981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:09.984066 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.984081 (+ 15us) client_negotiation.cc:769] Sending connection context
0806 15:10:09.984168 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 15:10:09.984228 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":414,"thread_start_us":90,"threads_started":1}
I20260806 15:10:09.985167 10950 tablet_service.cc:1467] Processing CreateTablet for tablet 4d520224fbec49d6b55fe44e4ad37b14 (DEFAULT_TABLE table=test-table [id=198e89c589c64926871ce97995ea7c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:09.985637 10950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d520224fbec49d6b55fe44e4ad37b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:09.990214 11182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.980259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:33659 (local address 127.0.0.1:45914)
0806 15:10:09.984791 (+ 4532us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:09.984803 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:09.984841 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:09.986599 (+ 1758us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:09.986600 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:09.986602 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:09.986635 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:09.986637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.988195 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.988196 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:09.989247 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:09.989250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.989979 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.989980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:09.990038 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.990041 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:10:09.990101 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 15:10:09.990143 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4519,"thread_start_us":87,"threads_started":1}
I20260806 15:10:09.990233 11181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.980387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45914 (local address 127.29.69.129:33659)
0806 15:10:09.986406 (+ 6019us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:09.986411 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:09.986424 (+ 13us) server_negotiation.cc:407] Connection header received
0806 15:10:09.986461 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:09.986464 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:09.986481 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:09.986585 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:09.986738 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.988109 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.989338 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.989870 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.989982 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.990041 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:09.990114 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 15:10:09.990159 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5975,"thread_start_us":56,"threads_started":1}
I20260806 15:10:09.991209 10813 tablet_service.cc:1467] Processing CreateTablet for tablet 4d520224fbec49d6b55fe44e4ad37b14 (DEFAULT_TABLE table=test-table [id=198e89c589c64926871ce97995ea7c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:09.991549 10813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d520224fbec49d6b55fe44e4ad37b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:09.994220 11180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.980509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:43295 (local address 127.0.0.1:55900)
0806 15:10:09.986709 (+ 6200us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:09.986720 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:09.986763 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:09.990579 (+ 3816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:09.990580 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:09.990582 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:09.990629 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:09.990631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.991840 (+ 1209us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.991841 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:09.992893 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:09.992896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.993970 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.993971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:09.994036 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.994040 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:09.994095 (+ 55us) client_negotiation.cc:240] Negotiation successful
0806 15:10:09.994136 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6181,"thread_start_us":87,"threads_started":1}
I20260806 15:10:09.994496 11184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:09.980602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55900 (local address 127.29.69.131:43295)
0806 15:10:09.990395 (+ 9793us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:09.990400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:09.990412 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:10:09.990449 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:09.990451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:09.990467 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:09.990572 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:09.990723 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.991738 (+ 1015us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.993004 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:09.993793 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:09.993874 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:09.993931 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:09.994349 (+ 418us) server_negotiation.cc:299] Negotiation successful
0806 15:10:09.994403 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9754,"thread_start_us":46,"threads_started":1}
I20260806 15:10:09.994491 11185 tablet_bootstrap.cc:492] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: Bootstrap starting.
I20260806 15:10:09.995201 11185 tablet_bootstrap.cc:654] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:09.995245 11085 tablet_service.cc:1467] Processing CreateTablet for tablet 4d520224fbec49d6b55fe44e4ad37b14 (DEFAULT_TABLE table=test-table [id=198e89c589c64926871ce97995ea7c58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:09.995549 11185 log.cc:824] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:09.995608 11085 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d520224fbec49d6b55fe44e4ad37b14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:09.995782 11186 tablet_bootstrap.cc:492] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: Bootstrap starting.
I20260806 15:10:09.996361 11186 tablet_bootstrap.cc:654] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:09.996670 11186 log.cc:824] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:09.997392 11186 tablet_bootstrap.cc:492] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: No bootstrap required, opened a new log
I20260806 15:10:09.997545 11186 ts_tablet_manager.cc:1397] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:10:09.999248 11189 tablet_bootstrap.cc:492] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: Bootstrap starting.
I20260806 15:10:09.999359 11185 tablet_bootstrap.cc:492] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: No bootstrap required, opened a new log
I20260806 15:10:09.999531 11185 ts_tablet_manager.cc:1397] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260806 15:10:09.999943 11189 tablet_bootstrap.cc:654] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:10.000345 11189 log.cc:824] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:10.000403 11186 raft_consensus.cc:348] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.000685 11186 raft_consensus.cc:374] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:10.000785 11186 raft_consensus.cc:729] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbb094368312459198988e06db28b138, State: Initialized, Role: FOLLOWER
I20260806 15:10:10.001001 11186 consensus_queue.cc:260] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.001154 11189 tablet_bootstrap.cc:492] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: No bootstrap required, opened a new log
I20260806 15:10:10.001220 11189 ts_tablet_manager.cc:1397] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:10.001377 11186 ts_tablet_manager.cc:1428] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260806 15:10:10.001636 10881 heartbeater.cc:503] Master 127.29.69.190:36143 was elected leader, sending a full tablet report...
I20260806 15:10:10.002233 11185 raft_consensus.cc:348] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.002408 11185 raft_consensus.cc:374] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:10.002440 11185 raft_consensus.cc:729] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c018831b4d734fcfaff485b650c5fc1e, State: Initialized, Role: FOLLOWER
I20260806 15:10:10.003463 11189 raft_consensus.cc:348] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.003580 11189 raft_consensus.cc:374] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:10.003600 11189 raft_consensus.cc:729] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d55dab8ff375494fbe87f8434de2027f, State: Initialized, Role: FOLLOWER
I20260806 15:10:10.003741 11189 consensus_queue.cc:260] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.004029 11152 heartbeater.cc:503] Master 127.29.69.190:36143 was elected leader, sending a full tablet report...
I20260806 15:10:10.004724 11189 ts_tablet_manager.cc:1428] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:10:10.006552 11185 consensus_queue.cc:260] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.006902 11185 ts_tablet_manager.cc:1428] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20260806 15:10:10.006917 11017 heartbeater.cc:503] Master 127.29.69.190:36143 was elected leader, sending a full tablet report...
W20260806 15:10:10.057669 10882 tablet.cc:2369] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 06 15:10:10 dist-test-slave-tm1g krb5kdc[9654](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029009, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for HTTP/127.29.69.148@KRBTEST.COM
I20260806 15:10:10.144860 11192 raft_consensus.cc:482] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:10.145018 11192 raft_consensus.cc:504] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.145419 11192 leader_election.cc:288] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c018831b4d734fcfaff485b650c5fc1e (127.29.69.130:46039), bbb094368312459198988e06db28b138 (127.29.69.129:33659)
I20260806 15:10:10.150718 11181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.146319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:51289 (local address 127.29.69.129:33659)
0806 15:10:10.146371 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:10.146373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:10.146879 (+ 506us) server_negotiation.cc:407] Connection header received
0806 15:10:10.146985 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:10.146986 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:10.146996 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:10.147023 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:10.147212 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.147919 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.149757 (+ 1838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.150283 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.150366 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:10.150376 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:10.150605 (+ 229us) server_negotiation.cc:299] Negotiation successful
0806 15:10:10.150649 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:10:10.151563 11197 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.145936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:33659 (local address 127.29.69.131:51289)
0806 15:10:10.146823 (+ 887us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:10.146833 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:10.146905 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:10.147084 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:10.147085 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:10.147086 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:10.147146 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:10.147147 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.148028 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.148029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:10.149223 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:10.149226 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.150454 (+ 1228us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.150455 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:10.150526 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:10.150530 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:10.151410 (+ 880us) client_negotiation.cc:240] Negotiation successful
0806 15:10:10.151458 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":868,"mutex_wait_us":1,"thread_start_us":71,"threads_started":1}
I20260806 15:10:10.152092 10833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d520224fbec49d6b55fe44e4ad37b14" candidate_uuid: "d55dab8ff375494fbe87f8434de2027f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbb094368312459198988e06db28b138" is_pre_election: true
I20260806 15:10:10.152249 10833 raft_consensus.cc:2454] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55dab8ff375494fbe87f8434de2027f in term 0.
I20260806 15:10:10.152567 11039 leader_election.cc:302] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbb094368312459198988e06db28b138, d55dab8ff375494fbe87f8434de2027f; no voters:
I20260806 15:10:10.152689 11192 raft_consensus.cc:2781] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:10:10.152724 11192 raft_consensus.cc:482] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:10:10.152743 11192 raft_consensus.cc:3037] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:10.152796 11183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.146172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:43147 (local address 127.29.69.130:46039)
0806 15:10:10.146255 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:10.146257 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:10.146267 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:10.146317 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:10.146318 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:10.146328 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:10.146385 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:10.148061 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.148791 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.151833 (+ 3042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.152387 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.152442 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:10.152451 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:10.152682 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 15:10:10.152727 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 15:10:10.153062 11196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.145701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:46039 (local address 127.29.69.131:43147)
0806 15:10:10.145898 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:10.145912 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:10.145974 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:10.146444 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:10.146564 (+ 120us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:10.146567 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:10.146652 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:10.146654 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.148904 (+ 2250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.148905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:10.151302 (+ 2397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:10.151306 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.152518 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.152518 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:10.152594 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:10.152598 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:10.152940 (+ 342us) client_negotiation.cc:240] Negotiation successful
0806 15:10:10.152986 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":113,"threads_started":1}
I20260806 15:10:10.153340 10971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d520224fbec49d6b55fe44e4ad37b14" candidate_uuid: "d55dab8ff375494fbe87f8434de2027f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c018831b4d734fcfaff485b650c5fc1e" is_pre_election: true
I20260806 15:10:10.153475 10971 raft_consensus.cc:2454] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d55dab8ff375494fbe87f8434de2027f in term 0.
I20260806 15:10:10.153709 11192 raft_consensus.cc:504] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.153846 11192 leader_election.cc:288] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [CANDIDATE]: Term 1 election: Requested vote from peers c018831b4d734fcfaff485b650c5fc1e (127.29.69.130:46039), bbb094368312459198988e06db28b138 (127.29.69.129:33659)
I20260806 15:10:10.154016 10971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d520224fbec49d6b55fe44e4ad37b14" candidate_uuid: "d55dab8ff375494fbe87f8434de2027f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c018831b4d734fcfaff485b650c5fc1e"
I20260806 15:10:10.154091 10971 raft_consensus.cc:3037] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:10.154367 10833 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d520224fbec49d6b55fe44e4ad37b14" candidate_uuid: "d55dab8ff375494fbe87f8434de2027f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbb094368312459198988e06db28b138"
I20260806 15:10:10.154440 10833 raft_consensus.cc:3037] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:10.155334 10971 raft_consensus.cc:2454] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55dab8ff375494fbe87f8434de2027f in term 1.
I20260806 15:10:10.155401 10833 raft_consensus.cc:2454] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d55dab8ff375494fbe87f8434de2027f in term 1.
I20260806 15:10:10.155571 11040 leader_election.cc:302] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c018831b4d734fcfaff485b650c5fc1e, d55dab8ff375494fbe87f8434de2027f; no voters:
I20260806 15:10:10.155664 11192 raft_consensus.cc:2781] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:10.155876 11192 raft_consensus.cc:686] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 1 LEADER]: Becoming Leader. State: Replica: d55dab8ff375494fbe87f8434de2027f, State: Running, Role: LEADER
I20260806 15:10:10.155984 11192 consensus_queue.cc:237] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } }
I20260806 15:10:10.156787 10677 catalog_manager.cc:5495] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f reported cstate change: term changed from 0 to 1, leader changed from <none> to d55dab8ff375494fbe87f8434de2027f (127.29.69.131). New cstate: current_term: 1 leader_uuid: "d55dab8ff375494fbe87f8434de2027f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d55dab8ff375494fbe87f8434de2027f" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 43295 } health_report { overall_health: HEALTHY } } }
I20260806 15:10:10.168700 11184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.165460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55902 (local address 127.29.69.131:43295)
0806 15:10:10.165500 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:10.165502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:10.165510 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:10.165582 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:10.165582 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:10.165601 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:10.165670 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:10.165859 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.166586 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.167659 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:10.167845 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:10.167945 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:10.168152 (+ 207us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:10.168280 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:10:10.168356 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:10.168628 (+ 272us) server_negotiation.cc:299] Negotiation successful
0806 15:10:10.168646 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:10:10.172715 10971 raft_consensus.cc:1261] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 1 FOLLOWER]: Refusing update from remote peer d55dab8ff375494fbe87f8434de2027f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:10.173125 11192 consensus_queue.cc:1035] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c018831b4d734fcfaff485b650c5fc1e" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46039 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:10.174180 10833 raft_consensus.cc:1261] T 4d520224fbec49d6b55fe44e4ad37b14 P bbb094368312459198988e06db28b138 [term 1 FOLLOWER]: Refusing update from remote peer d55dab8ff375494fbe87f8434de2027f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:10.174501 11192 consensus_queue.cc:1035] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbb094368312459198988e06db28b138" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 33659 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:10.186452 11204 mvcc.cc:205] Tried to move back new op lower bound from 7315574825662754816 to 7315574825599430656. Current Snapshot: MvccSnapshot[applied={T|T < 7315574825662754816}]
I20260806 15:10:10.187719 11201 mvcc.cc:205] Tried to move back new op lower bound from 7315574825662754816 to 7315574825599430656. Current Snapshot: MvccSnapshot[applied={T|T < 7315574825662754816}]
I20260806 15:10:10.194868 11202 mvcc.cc:205] Tried to move back new op lower bound from 7315574825662754816 to 7315574825599430656. Current Snapshot: MvccSnapshot[applied={T|T < 7315574825662754816}]
I20260806 15:10:10.197402 10677 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:10.197502 10677 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47866:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:10.198277 10677 catalog_manager.cc:5782] T 00000000000000000000000000000000 P aff3c4fca3c4452d86cccf18233ad78b: Sending DeleteTablet for 3 replicas of tablet 4d520224fbec49d6b55fe44e4ad37b14
I20260806 15:10:10.199054 10950 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d520224fbec49d6b55fe44e4ad37b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:10 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:48144
I20260806 15:10:10.199379 10813 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d520224fbec49d6b55fe44e4ad37b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:10 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:45914
I20260806 15:10:10.199613 11085 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d520224fbec49d6b55fe44e4ad37b14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:10 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:55900
I20260806 15:10:10.200167 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10718
I20260806 15:10:10.202422 11212 tablet_replica.cc:330] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f: stopping tablet replica
I20260806 15:10:10.202409 11210 tablet_replica.cc:330] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e: stopping tablet replica
I20260806 15:10:10.202517 11210 raft_consensus.cc:2229] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:10.202517 11212 raft_consensus.cc:2229] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:10:10.202627 11210 raft_consensus.cc:2258] T 4d520224fbec49d6b55fe44e4ad37b14 P c018831b4d734fcfaff485b650c5fc1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:10.202627 11212 raft_consensus.cc:2258] T 4d520224fbec49d6b55fe44e4ad37b14 P d55dab8ff375494fbe87f8434de2027f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260806 15:10:10.209657 10661 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:33659 (error 108)
I20260806 15:10:10.210827 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10885
I20260806 15:10:10.219033 11179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.218871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:33659 (local address 127.0.0.1:45918)
0806 15:10:10.218938 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:10.218988 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:33659: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260806 15:10:10.219281 10661 catalog_manager.cc:4584] TS bbb094368312459198988e06db28b138 (127.29.69.129:33659): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d520224fbec49d6b55fe44e4ad37b14: Network error: Client connection negotiation failed: client connection to 127.29.69.129:33659: connect: Connection refused (error 111)
W20260806 15:10:10.220050 11179 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:10:10.219805 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:46039 (local address 127.0.0.1:48152)
0806 15:10:10.219839 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:10.219849 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:10.219897 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:10.220010 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.130:46039: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":21}
I20260806 15:10:10.220584 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11020
I20260806 15:10:10.232115 11179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:10.232013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:43295 (local address 127.0.0.1:55904)
0806 15:10:10.232055 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:10.232077 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.131:43295: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 15:10:10.234340 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 10643
I20260806 15:10:10.241463 29974 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260806 15:10:10.596457 29974 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260806 15:10:10.596576 29974 mini_ranger.cc:66] Stopping Ranger...
I20260806 15:10:10.940709 29974 mini_ranger.cc:68] Stopped Ranger
2026-08-06 15:10:10.940 UTC [9684] LOG: received smart shutdown request
2026-08-06 15:10:10.945 UTC [9684] LOG: background worker "logical replication launcher" (PID 9694) exited with exit code 1
2026-08-06 15:10:10.945 UTC [9689] LOG: shutting down
2026-08-06 15:10:11.106 UTC [9684] LOG: database system is shut down
2026-08-06T15:10:11Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49546 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:10:11 dist-test-slave-tm1g krb5kdc[11222](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:10:11 dist-test-slave-tm1g krb5kdc[11222](info): set up 2 sockets
Aug 06 15:10:11 dist-test-slave-tm1g krb5kdc[11222](info): commencing operation
krb5kdc: starting...
W20260806 15:10:12.298693 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:10:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:10:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:10:12.412815 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:37569
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:37569,127.29.69.189:34671,127.29.69.188:39821
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:12.492669 11236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:12.492858 11236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:12.492882 11236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:12.493927 11236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:12.493963 11236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:12.493976 11236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:12.493989 11236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:12.494001 11236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:12.495465 11236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:37569,127.29.69.189:34671,127.29.69.188:39821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:37569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:12.495643 11236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:12.495811 11236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:12.500731 11244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:12.500737 11241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:12.500815 11236 server_base.cc:1034] running on GCE node
W20260806 15:10:12.500777 11242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:12.501189 11236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:12.501542 11236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:12.502717 11236 hybrid_clock.cc:648] HybridClock initialized: now 1786029012502707 us; error 38 us; skew 500 ppm
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:12.505151 11236 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:12.505648 11236 webserver.cc:460] Webserver started at http://127.29.69.190:34999/ using document root <none> and password file <none>
I20260806 15:10:12.505892 11236 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:12.505961 11236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:12.506114 11236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:12.507205 11236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "11b19475b32d43bcbe5f5950cc68be2c"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "9357408e3b9e85cd9f8db88eb7099a42"
server_key_iv: "ac9023db650be1baed824abfe0fed422"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.507571 11236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "11b19475b32d43bcbe5f5950cc68be2c"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "9357408e3b9e85cd9f8db88eb7099a42"
server_key_iv: "ac9023db650be1baed824abfe0fed422"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.508853 11236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:10:12.509584 11251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:12.509785 11236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:12.509895 11236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "11b19475b32d43bcbe5f5950cc68be2c"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "9357408e3b9e85cd9f8db88eb7099a42"
server_key_iv: "ac9023db650be1baed824abfe0fed422"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.509985 11236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:12.525695 11236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:12.527915 11236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:12.528066 11236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:12.532008 11236 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:37569
I20260806 15:10:12.532076 11304 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:37569 every 8 connection(s)
I20260806 15:10:12.532411 11236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:12.533308 11305 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:12.534866 11305 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.537055 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11236
I20260806 15:10:12.537179 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:10:12.537362 29974 external_mini_cluster.cc:1428] Setting key b97d6aa411b4afe7b5a792a49d23b068
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.69.189@KRBTEST.COM; defaulting to no policy
I20260806 15:10:12.545372 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.535544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40382 (local address 127.29.69.190:37569)
0806 15:10:12.535768 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.535771 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.535798 (+ 27us) server_negotiation.cc:407] Connection header received
0806 15:10:12.536286 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.536288 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.536304 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.536404 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.536917 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.538242 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.539503 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.539840 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.539929 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.542226 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.542239 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.542239 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.542245 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.543823 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.544216 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.544219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.544219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.544298 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.544526 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.544526 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.544527 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.544729 (+ 202us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.544820 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.545002 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.545136 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":84,"threads_started":1}
I20260806 15:10:12.545383 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.535524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:37569 (local address 127.0.0.1:40382)
0806 15:10:12.535701 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.535733 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.536146 (+ 413us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.536427 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.536430 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.536658 (+ 228us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.536803 (+ 145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.536806 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.538391 (+ 1585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.538392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.539391 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.539394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.539929 (+ 535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.539930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.539989 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.540532 (+ 543us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.540540 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.542128 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.543929 (+ 1801us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.543935 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.543937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.544123 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.544366 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.544367 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.544368 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.544458 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.544800 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.544805 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.544863 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.544977 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.545200 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":90,"thread_start_us":89,"threads_started":1}
I20260806 15:10:12.546276 11305 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.546645 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.546530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50176)
0806 15:10:12.546577 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.546624 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 15:10:12.546783 11252 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
I20260806 15:10:12.547191 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.547087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50190)
0806 15:10:12.547137 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.547162 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 15:10:12.547291 11305 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:34671: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab.
Entry for principal kudu/127.29.69.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab.
I20260806 15:10:12.560916 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:34671
--webserver_interface=127.29.69.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab
--principal=kudu/127.29.69.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:37569,127.29.69.189:34671,127.29.69.188:39821
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:12.596542 11305 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } attempt: 1
I20260806 15:10:12.597101 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.596921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50206)
0806 15:10:12.597002 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.597059 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260806 15:10:12.597507 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.597407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50222)
0806 15:10:12.597453 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.597485 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 15:10:12.597625 11305 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:34671: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
W20260806 15:10:12.642338 11312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:12.642578 11312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:12.642607 11312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:12.643761 11312 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:12.643802 11312 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:12.643816 11312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:12.643829 11312 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:12.643879 11312 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:12.645516 11312 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:37569,127.29.69.189:34671,127.29.69.188:39821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab
--principal=kudu/127.29.69.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:34671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.69.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11312
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:12.645764 11312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:12.645993 11312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:12.650758 11319 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:12.650825 11321 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:12.650877 11312 server_base.cc:1034] running on GCE node
W20260806 15:10:12.650769 11318 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:12.651196 11312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:12.651489 11312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:12.652630 11312 hybrid_clock.cc:648] HybridClock initialized: now 1786029012652613 us; error 38 us; skew 500 ppm
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:12.655143 11312 init.cc:377] Logged in from keytab as kudu/127.29.69.189@KRBTEST.COM (short username kudu)
I20260806 15:10:12.655537 11312 webserver.cc:460] Webserver started at http://127.29.69.189:39469/ using document root <none> and password file <none>
I20260806 15:10:12.655762 11312 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:12.655807 11312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:12.655951 11312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:12.656977 11312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data/instance:
uuid: "832a99049ea24bc8a1b57f77781591d9"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "a140639a417552f6c2a30baf449a0090"
server_key_iv: "469360ca0eb2d2165d6fbc361bbd8bc8"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.657342 11312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal/instance:
uuid: "832a99049ea24bc8a1b57f77781591d9"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "a140639a417552f6c2a30baf449a0090"
server_key_iv: "469360ca0eb2d2165d6fbc361bbd8bc8"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.658733 11312 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260806 15:10:12.659482 11328 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:12.659654 11312 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:12.659763 11312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal
uuid: "832a99049ea24bc8a1b57f77781591d9"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "a140639a417552f6c2a30baf449a0090"
server_key_iv: "469360ca0eb2d2165d6fbc361bbd8bc8"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.659839 11312 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:12.665796 11305 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } attempt: 2
I20260806 15:10:12.666173 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.666055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50232)
0806 15:10:12.666111 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.666147 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 15:10:12.666564 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.666466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50234)
0806 15:10:12.666512 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.666537 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 15:10:12.666652 11305 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:34671: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34671: connect: Connection refused (error 111)
I20260806 15:10:12.673156 11312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:12.675431 11312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:12.675597 11312 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:12.679602 11312 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.189:34671
I20260806 15:10:12.679666 11382 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.189:34671 every 8 connection(s)
I20260806 15:10:12.680018 11312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
I20260806 15:10:12.680855 11383 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:12.682437 11383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.685423 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11312
I20260806 15:10:12.685545 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-1/wal/instance
I20260806 15:10:12.685720 29974 external_mini_cluster.cc:1428] Setting key 8b6a49b06b5f78dce88921856eb02aba
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:12.692098 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.683204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.29.69.190:37569)
0806 15:10:12.683299 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.683301 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.683399 (+ 98us) server_negotiation.cc:407] Connection header received
0806 15:10:12.683862 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.683863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.683875 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.683937 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.684511 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.685018 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.686169 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.686445 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.686522 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.689022 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.689023 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.689023 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.689031 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.690531 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.691035 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.691036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.691036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.691089 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.691408 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.691409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.691409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.691519 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.691571 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.691964 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.692035 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260806 15:10:12.692381 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.683102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:37569 (local address 127.0.0.1:40392)
0806 15:10:12.683283 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.683318 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.683774 (+ 456us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.684006 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.684009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.684243 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.684424 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.684428 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.685094 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.685095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.686077 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.686080 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.686530 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.686531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.686661 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.687193 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.687204 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.688923 (+ 1719us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.690611 (+ 1688us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.690619 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.690621 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.690957 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.691159 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.691160 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.691161 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.691316 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.691615 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.691624 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.691801 (+ 177us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.691950 (+ 149us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.692134 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260806 15:10:12.692996 11383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.29.69.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.188@KRBTEST.COM" created.
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:10:12.701359 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.693249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50238)
0806 15:10:12.693473 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.693484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.693538 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.693681 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.693681 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.693833 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.693894 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.693896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.694808 (+ 912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.694809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.695437 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.695440 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.695873 (+ 433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.695874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.695943 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.696281 (+ 338us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.696286 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.698122 (+ 1836us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.700305 (+ 2183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.700306 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.700306 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.700466 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.700683 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.700684 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.700684 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.700738 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.701029 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.701030 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.701068 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.701139 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.701241 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260806 15:10:12.701443 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.693324 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50238 (local address 127.29.69.189:34671)
0806 15:10:12.693490 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.693494 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.693531 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:10:12.693597 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.693599 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.693610 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.693664 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.693977 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.694717 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.695508 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.695793 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.695877 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.698226 (+ 2349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.698234 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.698234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.698241 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.700210 (+ 1969us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.700558 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.700562 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.700562 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.700619 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.700811 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.700812 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.700813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.700956 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.701052 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.701178 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.701313 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":50,"server-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260806 15:10:12.701954 11383 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.702323 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.702184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60582)
0806 15:10:12.702231 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.702277 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 15:10:12.702453 11331 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
I20260806 15:10:12.702880 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.702786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60592)
0806 15:10:12.702834 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.702858 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 15:10:12.702983 11383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:39821: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab.
Entry for principal kudu/127.29.69.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab.
I20260806 15:10:12.713235 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:39821
--webserver_interface=127.29.69.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab
--principal=kudu/127.29.69.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:37569,127.29.69.189:34671,127.29.69.188:39821
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:12.752228 11383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } attempt: 1
I20260806 15:10:12.752815 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.752644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60604)
0806 15:10:12.752714 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.752757 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260806 15:10:12.753196 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.753107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60620)
0806 15:10:12.753151 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.753176 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 15:10:12.753304 11383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:39821: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
I20260806 15:10:12.757793 11305 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } attempt: 3
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:10:12.765179 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.758173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50254 (local address 127.29.69.189:34671)
0806 15:10:12.758229 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.758232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.758248 (+ 16us) server_negotiation.cc:407] Connection header received
0806 15:10:12.758275 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.758276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.758284 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.758393 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.758778 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.759282 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.760286 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.760516 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.760572 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.762637 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.762639 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.762639 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.762647 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.764051 (+ 1404us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.764394 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.764395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.764396 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.764463 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.764672 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.764672 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.764673 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.764782 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.764849 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.765014 (+ 165us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.765088 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 15:10:12.765184 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.758122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50254)
0806 15:10:12.758176 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.758186 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.758229 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.758409 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.758410 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.758594 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.758677 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.758679 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.759369 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.759370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.760201 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.760204 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.760591 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.760592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.760674 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.761112 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.761118 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.762547 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.764146 (+ 1599us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.764147 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.764147 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.764321 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.764536 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.764537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.764537 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.764603 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.764852 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.764853 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.764898 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.764987 (+ 89us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.765089 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:10:12.765611 11305 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.765967 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.765862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60628)
0806 15:10:12.765916 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.765950 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260806 15:10:12.766355 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.766235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60634)
0806 15:10:12.766278 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.766335 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 15:10:12.766458 11305 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:39821: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
W20260806 15:10:12.797290 11390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:12.797583 11390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:12.797624 11390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260806 15:10:12.797626 11305 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } attempt: 1
I20260806 15:10:12.798141 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.797984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60646)
0806 15:10:12.798070 (+ 86us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.798110 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260806 15:10:12.798588 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.798479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60654)
0806 15:10:12.798528 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.798565 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 15:10:12.798681 11305 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:39821: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
W20260806 15:10:12.799130 11390 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:12.799173 11390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:12.799188 11390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:12.799201 11390 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:12.799212 11390 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:12.800745 11390 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:37569,127.29.69.189:34671,127.29.69.188:39821
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab
--principal=kudu/127.29.69.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:39821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.69.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:12.800997 11390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:12.801225 11390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:12.805982 11395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:12.805971 11396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:12.806147 11390 server_base.cc:1034] running on GCE node
W20260806 15:10:12.805971 11398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:12.806528 11390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:12.806807 11390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:12.807968 11390 hybrid_clock.cc:648] HybridClock initialized: now 1786029012807965 us; error 33 us; skew 500 ppm
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:12.810230 11390 init.cc:377] Logged in from keytab as kudu/127.29.69.188@KRBTEST.COM (short username kudu)
I20260806 15:10:12.810716 11390 webserver.cc:460] Webserver started at http://127.29.69.188:39439/ using document root <none> and password file <none>
I20260806 15:10:12.810942 11390 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:12.811012 11390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:12.811159 11390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:12.812216 11390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data/instance:
uuid: "6f1562c22ae345c28a80865b5f61becd"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "58554f91415b06cb3ec0607f1ac01974"
server_key_iv: "bf50b41f64f005e7f2867c86fcbc3ff3"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.812584 11390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal/instance:
uuid: "6f1562c22ae345c28a80865b5f61becd"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "58554f91415b06cb3ec0607f1ac01974"
server_key_iv: "bf50b41f64f005e7f2867c86fcbc3ff3"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.813951 11390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:10:12.814730 11405 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:12.814924 11390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:12.815038 11390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal
uuid: "6f1562c22ae345c28a80865b5f61becd"
format_stamp: "Formatted at 2026-08-06 15:10:12 on dist-test-slave-tm1g"
server_key: "58554f91415b06cb3ec0607f1ac01974"
server_key_iv: "bf50b41f64f005e7f2867c86fcbc3ff3"
server_key_version: "encryptionkey@0"
I20260806 15:10:12.815111 11390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:12.821450 11383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } attempt: 2
I20260806 15:10:12.821820 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.821700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60656)
0806 15:10:12.821758 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.821793 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:10:12.822134 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.822040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60670)
0806 15:10:12.822084 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.822108 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 15:10:12.822216 11383 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:39821: Network error: Client connection negotiation failed: client connection to 127.29.69.188:39821: connect: Connection refused (error 111)
I20260806 15:10:12.829154 11390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:12.831080 11390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:12.831243 11390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:12.835263 11390 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.188:39821
I20260806 15:10:12.835294 11459 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.188:39821 every 8 connection(s)
I20260806 15:10:12.835635 11390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
I20260806 15:10:12.836474 11460 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:12.838040 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11390
I20260806 15:10:12.838160 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786028857624334-29974-0/minicluster-data/master-2/wal/instance
I20260806 15:10:12.837999 11460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.838385 29974 external_mini_cluster.cc:1428] Setting key 727f65bb6b712ce114ea4a5530ea335e
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:10:12.847882 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.838812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40396 (local address 127.29.69.190:37569)
0806 15:10:12.838874 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.838877 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.839121 (+ 244us) server_negotiation.cc:407] Connection header received
0806 15:10:12.839709 (+ 588us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.839711 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.839723 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.839788 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.840311 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.840809 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.841892 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.842194 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.842260 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.844598 (+ 2338us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.844600 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.844600 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.844607 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.846262 (+ 1655us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.846732 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.846734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.846734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.846808 (+ 74us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.847119 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.847120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.847120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.847293 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.847367 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.847689 (+ 322us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.847782 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:10:12.848026 11463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.838807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:37569 (local address 127.0.0.1:40396)
0806 15:10:12.838985 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.839031 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.839584 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.839818 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.839820 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.840070 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.840220 (+ 150us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.840224 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.840894 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.840895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.841800 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.841803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.842275 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.842276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.842429 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.842958 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.842965 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.844498 (+ 1533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.846411 (+ 1913us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.846420 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.846427 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.846644 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.846875 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.846877 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.846877 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.847038 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.847371 (+ 333us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.847377 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.847536 (+ 159us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.847641 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.847752 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
I20260806 15:10:12.848541 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.838883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60682 (local address 127.29.69.188:39821)
0806 15:10:12.839000 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.839009 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.839173 (+ 164us) server_negotiation.cc:407] Connection header received
0806 15:10:12.839586 (+ 413us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.839600 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.839625 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.839713 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.840371 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.841388 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.842266 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.842714 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.842797 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.845393 (+ 2596us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.845400 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.845400 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.845406 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.846876 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.847257 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.847260 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.847260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.847315 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.847547 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.847548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.847548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.847723 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.847878 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.848372 (+ 494us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.848458 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":62,"threads_started":1}
I20260806 15:10:12.848565 11460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:12.855533 11463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.848833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34671 (local address 127.0.0.1:50258)
0806 15:10:12.848865 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.848875 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.848909 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.849063 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.849064 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.849219 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.849278 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.849281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.849979 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.849979 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.850567 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.850570 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.850902 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.850903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.850981 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.851383 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.851388 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.852805 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.854543 (+ 1738us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.854544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.854544 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.854763 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.854961 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.854962 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.854962 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.855029 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.855259 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.855260 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.855306 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.855402 (+ 96us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.855476 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260806 15:10:12.855612 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.848898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50258 (local address 127.29.69.189:34671)
0806 15:10:12.848959 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.848962 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.848970 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:12.848993 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.848994 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.849004 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.849059 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.849345 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.849898 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.850653 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.850833 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.850880 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.852904 (+ 2024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.852905 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.852905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.852914 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.854470 (+ 1556us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.854845 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.854846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.854846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.854897 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.855095 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.855095 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.855095 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.855196 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.855244 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.855428 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.855500 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:10:12.855943 11460 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:10:12.856824 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.849273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40402 (local address 127.29.69.190:37569)
0806 15:10:12.849303 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.849305 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.849312 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:10:12.849352 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.849353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.849361 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.849407 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.849825 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.850379 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.851225 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.851433 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.851503 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.853692 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.853693 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.853693 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.853700 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.855290 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.856046 (+ 756us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.856047 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.856048 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.856108 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.856329 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.856330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.856330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.856474 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.856669 (+ 195us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.856710 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.856769 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:10:12.862282 11463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.856188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60692)
0806 15:10:12.856221 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.856232 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.856263 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.856375 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.856375 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.856517 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.856550 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.856552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.857458 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.857459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.858047 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.858049 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.858415 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.858416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.858475 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.858838 (+ 363us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.858842 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.859842 (+ 1000us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.861302 (+ 1460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.861303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.861304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.861468 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.861672 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.861673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.861673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.861742 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.861976 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.861976 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.862013 (+ 37us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.862082 (+ 69us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.862175 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260806 15:10:12.862365 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.856221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60692 (local address 127.29.69.188:39821)
0806 15:10:12.856254 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.856256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.856264 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:12.856310 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.856311 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.856323 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.856370 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.856623 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.857328 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.858124 (+ 796us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.858348 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.858414 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.859924 (+ 1510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.859925 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.859925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.859939 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.861208 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.861556 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.861556 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.861557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.861605 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.861812 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.861812 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.861813 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.861902 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.861983 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.862106 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.862223 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":16}
I20260806 15:10:12.863919 11460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: Bootstrap starting.
I20260806 15:10:12.864725 11460 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:12.864975 11460 log.cc:824] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:12.865159 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.857407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50268 (local address 127.29.69.189:34671)
0806 15:10:12.857444 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.857446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.857454 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:12.857484 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.857485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.857494 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.857546 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.857945 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.858555 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.859265 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.859471 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.859544 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.861917 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.861918 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.861918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.861924 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.863895 (+ 1971us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.864246 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.864247 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.864247 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.864301 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.864505 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.864506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.864506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.864613 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.864897 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.865012 (+ 115us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.865088 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:10:12.865845 11460 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: No bootstrap required, opened a new log
I20260806 15:10:12.867269 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:10:12.867647 11460 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:12.867802 11460 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:12.867844 11460 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f1562c22ae345c28a80865b5f61becd, State: Initialized, Role: FOLLOWER
I20260806 15:10:12.868083 11460 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:12.868456 11460 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:12.868410 11466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:12.868531 11466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:10:12.870554 11484 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:10:12.870617 11484 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:10:12.873808 11305 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } attempt: 2
I20260806 15:10:12.871531 11390 master_runner.cc:186] Error getting master registration for 127.29.69.190:37569: OK, instance_id { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" instance_seqno: 1786029012530974 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 15:10:12.874720 11390 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 15:10:12.878144 11308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.868909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40414 (local address 127.29.69.190:37569)
0806 15:10:12.868950 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.868952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.869352 (+ 400us) server_negotiation.cc:407] Connection header received
0806 15:10:12.869450 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.869451 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.869461 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.869516 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.870292 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.871087 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.872230 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.872531 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.872567 (+ 36us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.874663 (+ 2096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.874664 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.874665 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.874672 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.876359 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.876997 (+ 638us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.876998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.876999 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.877062 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.877533 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.877534 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.877534 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.877667 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.877738 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.877950 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.878046 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:10:12.878343 11387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.869201 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50274 (local address 127.29.69.189:34671)
0806 15:10:12.869241 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.869243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.870243 (+ 1000us) server_negotiation.cc:407] Connection header received
0806 15:10:12.870385 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.870386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.870396 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.870424 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.871132 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.871806 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.872738 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.872987 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.873020 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.875235 (+ 2215us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.875236 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.875236 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.875243 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.877000 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.877388 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.877390 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.877390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.877440 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.877639 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.877640 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.877640 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.877758 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.877861 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.878132 (+ 271us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.878206 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:10:12.880337 11464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.869001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60700 (local address 127.29.69.188:39821)
0806 15:10:12.869040 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.869042 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.869335 (+ 293us) server_negotiation.cc:407] Connection header received
0806 15:10:12.869440 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.869441 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.869451 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.869483 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.870731 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.871177 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.872203 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.872476 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.872516 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.875471 (+ 2955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.875473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.875473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.875481 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.877788 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.879414 (+ 1626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.879415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.879415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.879476 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.879702 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.879703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.879703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.879867 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.879979 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.880131 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.880215 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:10:12.882711 11486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.874096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60706 (local address 127.29.69.188:39821)
0806 15:10:12.874232 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.874234 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.874241 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:10:12.874259 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.874260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.874268 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.874712 (+ 444us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.874756 (+ 44us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.875579 (+ 823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.876566 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.876912 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.876975 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.879888 (+ 2913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.879889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.879889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.879895 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.881572 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.881947 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.881947 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.881948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.882015 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.882214 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.882215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.882215 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.882348 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.882429 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.882571 (+ 142us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.882629 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":86,"threads_started":1}
I20260806 15:10:12.882735 11307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.874037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60706)
0806 15:10:12.874076 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.874086 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.874120 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.874427 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.874428 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.874595 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.874635 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.874637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.875676 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.875677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.876469 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.876471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.876975 (+ 504us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.876977 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.877044 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.877908 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.877913 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.879784 (+ 1871us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.881659 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.881660 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.881660 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.881872 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.882082 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.882083 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.882084 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.882151 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.882430 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.882431 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.882475 (+ 44us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.882555 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.882643 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260806 15:10:12.883986 11305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: Bootstrap starting.
I20260806 15:10:12.884599 11305 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:12.884892 11305 log.cc:824] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:12.885628 11305 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: No bootstrap required, opened a new log
I20260806 15:10:12.887338 11305 raft_consensus.cc:348] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:12.887476 11305 raft_consensus.cc:374] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:12.887542 11305 raft_consensus.cc:729] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11b19475b32d43bcbe5f5950cc68be2c, State: Initialized, Role: FOLLOWER
I20260806 15:10:12.887691 11305 consensus_queue.cc:260] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:12.887989 11488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:12.888041 11305 sys_catalog.cc:564] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:12.888087 11488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:10:12.889950 11499 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:10:12.890004 11499 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:10:12.890594 11236 master_runner.cc:186] Error getting master registration for 127.29.69.189:34671: OK, instance_id { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" instance_seqno: 1786029012678398 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 15:10:12.892813 11236 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 15:10:12.913353 11383 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } attempt: 3
Aug 06 15:10:12 dist-test-slave-tm1g krb5kdc[11222](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029012, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:10:12.921967 11385 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.913652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:39821 (local address 127.0.0.1:60720)
0806 15:10:12.913703 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:12.913714 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:12.913752 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:12.913911 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:12.913912 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:12.914102 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:12.914158 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.914160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.915138 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.915139 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.915983 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:12.915985 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.916512 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.916513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:12.916574 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.917084 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:12.917089 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:12.918807 (+ 1718us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:12.920839 (+ 2032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.920840 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.920841 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.921061 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.921283 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:12.921284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:12.921285 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:12.921362 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:12.921647 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:12.921648 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:12.921697 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 15:10:12.921773 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 15:10:12.921867 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 15:10:12.922254 11486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:12.913711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60720 (local address 127.29.69.188:39821)
0806 15:10:12.913763 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:12.913765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:12.913775 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:12.913800 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:12.913801 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:12.913826 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:12.913889 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:12.914240 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.915050 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.916076 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:12.916423 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:12.916502 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:12.918932 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:12.918934 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:12.918934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:12.918941 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:12.920750 (+ 1809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.921146 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.921147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.921147 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.921210 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:12.921435 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:12.921436 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:12.921437 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:12.921573 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:12.921641 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:12.921811 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 15:10:12.921910 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 15:10:12.923940 11383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9: Bootstrap starting.
I20260806 15:10:12.924731 11383 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:12.925033 11383 log.cc:824] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:12.925951 11383 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9: No bootstrap required, opened a new log
I20260806 15:10:12.928071 11383 raft_consensus.cc:348] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:12.928213 11383 raft_consensus.cc:374] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:12.928249 11383 raft_consensus.cc:729] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 832a99049ea24bc8a1b57f77781591d9, State: Initialized, Role: FOLLOWER
I20260806 15:10:12.928369 11383 consensus_queue.cc:260] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:12.929350 11383 sys_catalog.cc:564] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:12.929322 11502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
W20260806 15:10:12.931268 11513 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:10:12.931381 11513 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:10:12.933147 11312 master_runner.cc:263] No leader master found from master 832a99049ea24bc8a1b57f77781591d9
I20260806 15:10:12.933200 11312 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 15:10:12.930718 11502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:10:13.028846 11257 tablet.cc:2369] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:10:13.081874 11411 tablet.cc:2369] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:10:13.138123 11502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:13.138236 11502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:13.138540 11502 leader_election.cc:288] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11b19475b32d43bcbe5f5950cc68be2c (127.29.69.190:37569), 6f1562c22ae345c28a80865b5f61becd (127.29.69.188:39821)
I20260806 15:10:13.138795 11279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "832a99049ea24bc8a1b57f77781591d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b19475b32d43bcbe5f5950cc68be2c" is_pre_election: true
I20260806 15:10:13.138823 11433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "832a99049ea24bc8a1b57f77781591d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f1562c22ae345c28a80865b5f61becd" is_pre_election: true
I20260806 15:10:13.138937 11279 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832a99049ea24bc8a1b57f77781591d9 in term 0.
I20260806 15:10:13.139010 11433 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 832a99049ea24bc8a1b57f77781591d9 in term 0.
I20260806 15:10:13.139190 11329 leader_election.cc:302] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b19475b32d43bcbe5f5950cc68be2c, 832a99049ea24bc8a1b57f77781591d9; no voters:
I20260806 15:10:13.139344 11502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:10:13.139403 11502 raft_consensus.cc:482] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:10:13.139420 11502 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:13.140218 11502 raft_consensus.cc:504] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:13.140350 11502 leader_election.cc:288] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [CANDIDATE]: Term 1 election: Requested vote from peers 11b19475b32d43bcbe5f5950cc68be2c (127.29.69.190:37569), 6f1562c22ae345c28a80865b5f61becd (127.29.69.188:39821)
I20260806 15:10:13.140529 11279 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "832a99049ea24bc8a1b57f77781591d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11b19475b32d43bcbe5f5950cc68be2c"
I20260806 15:10:13.140530 11433 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "832a99049ea24bc8a1b57f77781591d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f1562c22ae345c28a80865b5f61becd"
I20260806 15:10:13.140605 11279 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:13.140625 11433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:13.141321 11279 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 832a99049ea24bc8a1b57f77781591d9 in term 1.
I20260806 15:10:13.141498 11433 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 832a99049ea24bc8a1b57f77781591d9 in term 1.
I20260806 15:10:13.141492 11329 leader_election.cc:302] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 11b19475b32d43bcbe5f5950cc68be2c, 832a99049ea24bc8a1b57f77781591d9; no voters:
I20260806 15:10:13.141607 11502 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:13.141791 11502 raft_consensus.cc:686] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [term 1 LEADER]: Becoming Leader. State: Replica: 832a99049ea24bc8a1b57f77781591d9, State: Running, Role: LEADER
I20260806 15:10:13.141899 11502 consensus_queue.cc:237] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } }
I20260806 15:10:13.142367 11515 sys_catalog.cc:455] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 832a99049ea24bc8a1b57f77781591d9. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.142462 11515 sys_catalog.cc:458] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:13.142657 11517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:13.142850 11517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:13.144243 11433 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [term 1 FOLLOWER]: Refusing update from remote peer 832a99049ea24bc8a1b57f77781591d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:13.144279 11279 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [term 1 FOLLOWER]: Refusing update from remote peer 832a99049ea24bc8a1b57f77781591d9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:13.144586 11502 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:13.144716 11515 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:13.145864 11466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 832a99049ea24bc8a1b57f77781591d9. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.145982 11466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:10:13.145928 11488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 832a99049ea24bc8a1b57f77781591d9. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.146009 11488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:10:13.146828 11502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.146919 11502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:13.147034 11502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.147099 11502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:13.147060 11466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.147141 11466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:10:13.147521 11488 sys_catalog.cc:455] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "832a99049ea24bc8a1b57f77781591d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11b19475b32d43bcbe5f5950cc68be2c" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 37569 } } peers { permanent_uuid: "832a99049ea24bc8a1b57f77781591d9" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34671 } } peers { permanent_uuid: "6f1562c22ae345c28a80865b5f61becd" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 39821 } } }
I20260806 15:10:13.147606 11488 sys_catalog.cc:458] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:10:13.147905 11517 catalog_manager.cc:1347] Generated new cluster ID: b53f940a69fa4adf848030c35d995310
I20260806 15:10:13.147956 11517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:13.160178 11517 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:10:13.160693 11517 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:13.166536 11517 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 832a99049ea24bc8a1b57f77781591d9: Generated new TSK 0
I20260806 15:10:13.166711 11517 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:10:13.871132 11484 catalog_manager.cc:1259] Loaded cluster ID: b53f940a69fa4adf848030c35d995310
I20260806 15:10:13.871217 11484 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: loading cluster ID for follower catalog manager: success
I20260806 15:10:13.872077 11484 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: acquiring CA information for follower catalog manager: success
I20260806 15:10:13.872421 11484 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6f1562c22ae345c28a80865b5f61becd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:10:13.890475 11499 catalog_manager.cc:1259] Loaded cluster ID: b53f940a69fa4adf848030c35d995310
I20260806 15:10:13.890547 11499 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: loading cluster ID for follower catalog manager: success
I20260806 15:10:13.891412 11499 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: acquiring CA information for follower catalog manager: success
I20260806 15:10:13.891733 11499 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 11b19475b32d43bcbe5f5950cc68be2c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:10:14.232510 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11236
I20260806 15:10:14.238840 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11312
I20260806 15:10:14.244238 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11390
2026-08-06T15:10:14Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3019 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:10:14 dist-test-slave-tm1g krb5kdc[11532](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:10:14 dist-test-slave-tm1g krb5kdc[11532](info): set up 2 sockets
Aug 06 15:10:14 dist-test-slave-tm1g krb5kdc[11532](info): commencing operation
krb5kdc: starting...
W20260806 15:10:15.291239 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:10:15 dist-test-slave-tm1g krb5kdc[11532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:10:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:10:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:10:15.406687 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35111
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:36867
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:35111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:15.486284 11545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:15.486497 11545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:15.486518 11545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:15.487576 11545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:15.487607 11545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:15.487622 11545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:15.487634 11545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:15.487646 11545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:15.488993 11545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:36867
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:35111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:15.489168 11545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:15.489327 11545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:15.494032 11551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:15.494045 11552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:15.494154 11545 server_base.cc:1034] running on GCE node
W20260806 15:10:15.494032 11554 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:15.494539 11545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:15.494827 11545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:15.495993 11545 hybrid_clock.cc:648] HybridClock initialized: now 1786029015495974 us; error 47 us; skew 500 ppm
Aug 06 15:10:15 dist-test-slave-tm1g krb5kdc[11532](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029015, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:15.498368 11545 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:15.498808 11545 webserver.cc:460] Webserver started at http://127.29.69.190:34969/ using document root <none> and password file <none>
I20260806 15:10:15.498980 11545 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:15.499018 11545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:15.499106 11545 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:15.500066 11545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "813f38e7cd784c3ca3540a1852871d96"
format_stamp: "Formatted at 2026-08-06 15:10:15 on dist-test-slave-tm1g"
server_key: "f2bb5dd2651ddec6734f361aba83acdb"
server_key_iv: "dcdf077bb9b53c03918e04895677fd58"
server_key_version: "encryptionkey@0"
I20260806 15:10:15.500361 11545 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "813f38e7cd784c3ca3540a1852871d96"
format_stamp: "Formatted at 2026-08-06 15:10:15 on dist-test-slave-tm1g"
server_key: "f2bb5dd2651ddec6734f361aba83acdb"
server_key_iv: "dcdf077bb9b53c03918e04895677fd58"
server_key_version: "encryptionkey@0"
I20260806 15:10:15.501649 11545 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:10:15.502388 11562 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:15.502547 11545 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:15.502638 11545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "813f38e7cd784c3ca3540a1852871d96"
format_stamp: "Formatted at 2026-08-06 15:10:15 on dist-test-slave-tm1g"
server_key: "f2bb5dd2651ddec6734f361aba83acdb"
server_key_iv: "dcdf077bb9b53c03918e04895677fd58"
server_key_version: "encryptionkey@0"
I20260806 15:10:15.502693 11545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:15.522281 11545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:15.524546 11545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:15.524652 11545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:15.528888 11545 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:35111
I20260806 15:10:15.528940 11615 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:35111 every 8 connection(s)
I20260806 15:10:15.529287 11545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:15.530200 11616 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:15.530900 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11545
I20260806 15:10:15.530999 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:10:15.531189 29974 external_mini_cluster.cc:1428] Setting key d89177f84f37f4ec59651c3090a986f1
I20260806 15:10:15.533402 11616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96: Bootstrap starting.
I20260806 15:10:15.534099 11616 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:15.534431 11616 log.cc:824] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:15.535128 11616 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96: No bootstrap required, opened a new log
I20260806 15:10:15.537066 11616 raft_consensus.cc:348] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813f38e7cd784c3ca3540a1852871d96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35111 } }
I20260806 15:10:15.537197 11616 raft_consensus.cc:374] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:15.537225 11616 raft_consensus.cc:729] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 813f38e7cd784c3ca3540a1852871d96, State: Initialized, Role: FOLLOWER
I20260806 15:10:15.537395 11616 consensus_queue.cc:260] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813f38e7cd784c3ca3540a1852871d96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35111 } }
I20260806 15:10:15.537462 11616 raft_consensus.cc:388] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:15.537485 11616 raft_consensus.cc:482] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:15.537552 11616 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 0 FOLLOWER]: Advancing to term 1
Aug 06 15:10:15 dist-test-slave-tm1g krb5kdc[11532](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029015, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:15.538080 11616 raft_consensus.cc:504] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813f38e7cd784c3ca3540a1852871d96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35111 } }
I20260806 15:10:15.538215 11616 leader_election.cc:302] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 813f38e7cd784c3ca3540a1852871d96; no voters:
I20260806 15:10:15.538442 11616 leader_election.cc:288] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:10:15.538496 11621 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:15.538679 11621 raft_consensus.cc:686] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [term 1 LEADER]: Becoming Leader. State: Replica: 813f38e7cd784c3ca3540a1852871d96, State: Running, Role: LEADER
I20260806 15:10:15.538789 11621 consensus_queue.cc:237] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813f38e7cd784c3ca3540a1852871d96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35111 } }
I20260806 15:10:15.538694 11616 sys_catalog.cc:564] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:15.539110 11621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 813f38e7cd784c3ca3540a1852871d96. Latest consensus state: current_term: 1 leader_uuid: "813f38e7cd784c3ca3540a1852871d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813f38e7cd784c3ca3540a1852871d96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35111 } } }
I20260806 15:10:15.539120 11622 sys_catalog.cc:455] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "813f38e7cd784c3ca3540a1852871d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "813f38e7cd784c3ca3540a1852871d96" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35111 } } }
I20260806 15:10:15.539235 11621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:15.539321 11622 sys_catalog.cc:458] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:15.539491 11625 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:15.539991 11625 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:15.541484 11625 catalog_manager.cc:1347] Generated new cluster ID: 24a270653f0445faab6c80140d5d3cfe
I20260806 15:10:15.541535 11625 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:15.542721 11619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:15.531704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32974 (local address 127.29.69.190:35111)
0806 15:10:15.531928 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:15.531938 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:15.531970 (+ 32us) server_negotiation.cc:407] Connection header received
0806 15:10:15.532497 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:15.532505 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:15.532564 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:15.532716 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:15.533307 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:15.534736 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:15.535552 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:15.535986 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:15.536103 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:15.538653 (+ 2550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:15.538657 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:15.538658 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:15.538670 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:15.540788 (+ 2118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:15.541197 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:15.541200 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:15.541200 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:15.541301 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:15.541557 (+ 256us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:15.541558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:15.541559 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:15.541839 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:15.541974 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:15.542400 (+ 426us) server_negotiation.cc:299] Negotiation successful
0806 15:10:15.542533 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":168,"thread_start_us":58,"threads_started":1}
I20260806 15:10:15.543730 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:10:15.568563 11625 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:10:15.569341 11625 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:15.578914 11625 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 813f38e7cd784c3ca3540a1852871d96: Generated new TSK 0
I20260806 15:10:15.579105 11625 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:10:15.597702 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11545
2026-08-06T15:10:15Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1352 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:10:15 dist-test-slave-tm1g krb5kdc[11643](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:10:15 dist-test-slave-tm1g krb5kdc[11643](info): set up 2 sockets
Aug 06 15:10:15 dist-test-slave-tm1g krb5kdc[11643](info): commencing operation
krb5kdc: starting...
W20260806 15:10:16.643723 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:10:16 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:10:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:10:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:10:16.755292 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40503
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:40503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:16.836293 11656 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:16.836509 11656 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:16.836532 11656 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:16.837708 11656 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:16.837751 11656 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:16.837766 11656 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:16.837779 11656 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:16.837792 11656 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:16.839330 11656 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:40503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11656
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:16.839601 11656 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:16.839839 11656 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:16.844892 11663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:16.844843 11665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:16.844942 11656 server_base.cc:1034] running on GCE node
W20260806 15:10:16.844842 11662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:16.845300 11656 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:16.845618 11656 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:16.846789 11656 hybrid_clock.cc:648] HybridClock initialized: now 1786029016846785 us; error 39 us; skew 500 ppm
Aug 06 15:10:16 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029016, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:16.854507 11656 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:16.854907 11656 webserver.cc:460] Webserver started at http://127.29.69.190:44955/ using document root <none> and password file <none>
I20260806 15:10:16.855099 11656 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:16.855140 11656 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:16.855229 11656 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:16.856242 11656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "70d00687b4574084b4ebd73b72c07f03"
format_stamp: "Formatted at 2026-08-06 15:10:16 on dist-test-slave-tm1g"
server_key: "7f2150a4390773f7af763f09b00d7b7c"
server_key_iv: "8172415c0617a0bd748822cb168feca2"
server_key_version: "encryptionkey@0"
I20260806 15:10:16.856541 11656 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "70d00687b4574084b4ebd73b72c07f03"
format_stamp: "Formatted at 2026-08-06 15:10:16 on dist-test-slave-tm1g"
server_key: "7f2150a4390773f7af763f09b00d7b7c"
server_key_iv: "8172415c0617a0bd748822cb168feca2"
server_key_version: "encryptionkey@0"
I20260806 15:10:16.857919 11656 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:10:16.858727 11672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:16.858960 11656 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:16.859054 11656 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "70d00687b4574084b4ebd73b72c07f03"
format_stamp: "Formatted at 2026-08-06 15:10:16 on dist-test-slave-tm1g"
server_key: "7f2150a4390773f7af763f09b00d7b7c"
server_key_iv: "8172415c0617a0bd748822cb168feca2"
server_key_version: "encryptionkey@0"
I20260806 15:10:16.859114 11656 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:16.882849 11656 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:16.884991 11656 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:16.885108 11656 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:16.888870 11656 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:40503
I20260806 15:10:16.888918 11725 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:40503 every 8 connection(s)
I20260806 15:10:16.889247 11656 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:16.889688 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11656
I20260806 15:10:16.889792 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:10:16.889986 29974 external_mini_cluster.cc:1428] Setting key 550b7a8e132d59dd855c15239a275156
I20260806 15:10:16.890494 11726 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:16.893821 11726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap starting.
I20260806 15:10:16.894548 11726 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:16.894853 11726 log.cc:824] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:16.895501 11726 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: No bootstrap required, opened a new log
Aug 06 15:10:16 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029016, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:16.897578 11726 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:16.897728 11726 raft_consensus.cc:374] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:16.897750 11726 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d00687b4574084b4ebd73b72c07f03, State: Initialized, Role: FOLLOWER
I20260806 15:10:16.897921 11726 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:16.897986 11726 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:16.898027 11726 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:16.898077 11726 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:16.898687 11726 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:16.898774 11726 leader_election.cc:302] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70d00687b4574084b4ebd73b72c07f03; no voters:
I20260806 15:10:16.898967 11726 leader_election.cc:288] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:10:16.899026 11731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:16.899196 11731 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 LEADER]: Becoming Leader. State: Replica: 70d00687b4574084b4ebd73b72c07f03, State: Running, Role: LEADER
I20260806 15:10:16.899226 11726 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:16.899349 11731 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:16.899919 11732 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "70d00687b4574084b4ebd73b72c07f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } } }
I20260806 15:10:16.899904 11733 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70d00687b4574084b4ebd73b72c07f03. Latest consensus state: current_term: 1 leader_uuid: "70d00687b4574084b4ebd73b72c07f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } } }
I20260806 15:10:16.900018 11732 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:16.900079 11733 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:16.900259 11738 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:16.900861 11738 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:16.902076 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:16.890667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39530 (local address 127.29.69.190:40503)
0806 15:10:16.890828 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:16.890835 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:16.890859 (+ 24us) server_negotiation.cc:407] Connection header received
0806 15:10:16.891276 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:16.891281 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:16.891323 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:16.891436 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:16.892204 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:16.893075 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:16.894141 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:16.894631 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:16.894742 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:16.897332 (+ 2590us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:16.897336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:16.897337 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:16.897348 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:16.899543 (+ 2195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:16.900093 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:16.900096 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:16.900097 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:16.900222 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:16.900507 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:16.900508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:16.900508 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:16.900832 (+ 324us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:16.901468 (+ 636us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:16.901541 (+ 73us) server_negotiation.cc:299] Negotiation successful
0806 15:10:16.901880 (+ 339us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260806 15:10:16.902822 11738 catalog_manager.cc:1347] Generated new cluster ID: bb67029c486c4eafa4398bc10e7ed262
I20260806 15:10:16.902873 11738 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:16.920532 11738 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:10:16.921051 11738 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:16.926460 11738 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Generated new TSK 0
I20260806 15:10:16.926635 11738 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:10:16.957139 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40503
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:17.038678 11752 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:17.038865 11752 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:17.038888 11752 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:17.040032 11752 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:17.040076 11752 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:17.040102 11752 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:17.041613 11752 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11752
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:17.041854 11752 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:17.042100 11752 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:17.047039 11758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.047032 11760 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.047057 11757 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:17.047037 11752 server_base.cc:1034] running on GCE node
I20260806 15:10:17.047420 11752 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:17.047611 11752 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:17.048744 11752 hybrid_clock.cc:648] HybridClock initialized: now 1786029017048731 us; error 31 us; skew 500 ppm
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:17.051544 11752 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:17.051962 11752 webserver.cc:460] Webserver started at http://127.29.69.129:38741/ using document root <none> and password file <none>
I20260806 15:10:17.052199 11752 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:17.052245 11752 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:17.052407 11752 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:17.053426 11752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "c64984ba4378ebd1677ffbfc4b5ba8b1"
server_key_iv: "e96403ccb7d52c80d62d4c809ea61778"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.053772 11752 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "c64984ba4378ebd1677ffbfc4b5ba8b1"
server_key_iv: "e96403ccb7d52c80d62d4c809ea61778"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.055241 11752 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:10:17.056001 11767 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.056213 11752 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:17.056313 11752 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "c64984ba4378ebd1677ffbfc4b5ba8b1"
server_key_iv: "e96403ccb7d52c80d62d4c809ea61778"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.056385 11752 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:17.064714 11752 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:17.066695 11752 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:17.066846 11752 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:17.067049 11752 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:17.067329 11752 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:17.067382 11752 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.067422 11752 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:17.067451 11752 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.073045 11752 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:44137
I20260806 15:10:17.073134 11884 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:44137 every 8 connection(s)
I20260806 15:10:17.073419 11752 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:17.081831 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11752
I20260806 15:10:17.081949 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:10:17.082135 29974 external_mini_cluster.cc:1428] Setting key ec63ae906952c1fb4d55d1d66171829b
I20260806 15:10:17.082749 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.074175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:52925 (local address 127.29.69.190:40503)
0806 15:10:17.074254 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.074256 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.074484 (+ 228us) server_negotiation.cc:407] Connection header received
0806 15:10:17.075017 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.075018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.075031 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.075084 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:17.075989 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.076525 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.077646 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.077873 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.077965 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.080054 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:17.080056 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:17.080056 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:17.080062 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:17.081264 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.081640 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.081641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.081641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.081690 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.082047 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.082048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.082048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.082190 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:17.082262 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.082576 (+ 314us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.082660 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:10:17.082948 11887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.074132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:52925)
0806 15:10:17.074362 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.074396 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.074895 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.075155 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.075159 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.075710 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:17.075889 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.075894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.076622 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.076623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.077547 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.077550 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.077980 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.077982 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.078101 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.078641 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:17.078648 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:17.079968 (+ 1320us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:17.081339 (+ 1371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.081345 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.081347 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.081560 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.081755 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.081756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.081757 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.081900 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.082253 (+ 353us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:17.082261 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:17.082429 (+ 168us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.082557 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.082717 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":99,"threads_started":1}
I20260806 15:10:17.084650 11885 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40503
I20260806 15:10:17.084733 11885 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:17.084921 11885 heartbeater.cc:511] Master 127.29.69.190:40503 requested a full tablet report, sending...
I20260806 15:10:17.085490 11689 ts_manager.cc:194] Registered new tserver with Master: 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137)
I20260806 15:10:17.086427 11689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:52925
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:10:17.107131 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40503
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:17.188086 11890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:17.188277 11890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:17.188300 11890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:17.189358 11890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:17.189391 11890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:17.189416 11890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:10:17.190785 11890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11890
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:17.191015 11890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:17.191239 11890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:17.196097 11896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.196103 11895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.196105 11898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:17.196442 11890 server_base.cc:1034] running on GCE node
I20260806 15:10:17.196631 11890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:17.196856 11890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:17.198035 11890 hybrid_clock.cc:648] HybridClock initialized: now 1786029017198008 us; error 35 us; skew 500 ppm
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:17.201195 11890 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:17.201620 11890 webserver.cc:460] Webserver started at http://127.29.69.130:37251/ using document root <none> and password file <none>
I20260806 15:10:17.201853 11890 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:17.201905 11890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:17.202030 11890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:17.203138 11890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "643e0991fce7441f8755dde948bed15b"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "22538ee96237ec3dd4b68d756039eb9d"
server_key_iv: "447481b8f85f290cbeb64b1c5799f542"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.203507 11890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "643e0991fce7441f8755dde948bed15b"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "22538ee96237ec3dd4b68d756039eb9d"
server_key_iv: "447481b8f85f290cbeb64b1c5799f542"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.204836 11890 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:10:17.205641 11905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.205833 11890 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:17.205942 11890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "643e0991fce7441f8755dde948bed15b"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "22538ee96237ec3dd4b68d756039eb9d"
server_key_iv: "447481b8f85f290cbeb64b1c5799f542"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.206032 11890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:17.229318 11890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:17.231777 11890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:17.231949 11890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:17.232194 11890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:17.232519 11890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:17.232575 11890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.232609 11890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:17.232636 11890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.238564 11890 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:42689
I20260806 15:10:17.238611 12020 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:42689 every 8 connection(s)
I20260806 15:10:17.238927 11890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:10:17.241729 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 11890
I20260806 15:10:17.241812 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:10:17.242010 29974 external_mini_cluster.cc:1428] Setting key 0879a4c3481dc617fe9ca75f4a13c1b7
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:17.249132 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.239674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:36289 (local address 127.29.69.190:40503)
0806 15:10:17.239779 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.239782 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.239947 (+ 165us) server_negotiation.cc:407] Connection header received
0806 15:10:17.240495 (+ 548us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.240496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.240508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.240570 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:17.241561 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.242193 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.243337 (+ 1144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.243616 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.243710 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.245810 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:17.245812 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:17.245813 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:17.245820 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:17.247691 (+ 1871us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.248102 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.248104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.248105 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.248171 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.248418 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.248419 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.248419 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.248571 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:17.248654 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.248937 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.249024 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 15:10:17.249204 12023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.239592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:36289)
0806 15:10:17.239812 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.239863 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.240380 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.240642 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.240646 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.241211 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:17.241438 (+ 227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.241443 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.242285 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.242286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.243230 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.243232 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.243723 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.243724 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.243851 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.244362 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:17.244375 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:17.245723 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:17.247783 (+ 2060us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.247790 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.247791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.248023 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.248244 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.248244 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.248245 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.248347 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.248666 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:17.248673 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:17.248795 (+ 122us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.248897 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.249021 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":92,"threads_started":1}
I20260806 15:10:17.249734 12021 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40503
I20260806 15:10:17.249843 12021 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:17.250044 12021 heartbeater.cc:511] Master 127.29.69.190:40503 requested a full tablet report, sending...
I20260806 15:10:17.250510 11689 ts_manager.cc:194] Registered new tserver with Master: 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
I20260806 15:10:17.250888 11689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:36289
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:10:17.268808 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40503
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:17.349100 12026 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:17.349293 12026 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:17.349316 12026 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:17.350389 12026 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:17.350423 12026 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:17.350449 12026 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:17.351785 12026 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12026
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:17.351963 12026 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:17.352133 12026 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:17.356973 12031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.356980 12032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.356980 12034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:17.357286 12026 server_base.cc:1034] running on GCE node
I20260806 15:10:17.357482 12026 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:17.357662 12026 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:17.358796 12026 hybrid_clock.cc:648] HybridClock initialized: now 1786029017358775 us; error 34 us; skew 500 ppm
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:17.361311 12026 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:17.361788 12026 webserver.cc:460] Webserver started at http://127.29.69.131:34345/ using document root <none> and password file <none>
I20260806 15:10:17.362017 12026 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:17.362088 12026 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:17.362246 12026 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:17.363345 12026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "dddd1c6553c046b6a6e16a80ec029252"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "3117901924369abc1b4dde09d7537462"
server_key_iv: "271dc3307c018f193e3e744abc648c5e"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.363705 12026 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "dddd1c6553c046b6a6e16a80ec029252"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "3117901924369abc1b4dde09d7537462"
server_key_iv: "271dc3307c018f193e3e744abc648c5e"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.365090 12026 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:10:17.365897 12041 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.366106 12026 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:17.366209 12026 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "dddd1c6553c046b6a6e16a80ec029252"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "3117901924369abc1b4dde09d7537462"
server_key_iv: "271dc3307c018f193e3e744abc648c5e"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.366290 12026 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:17.395680 12026 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:17.397962 12026 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:17.398123 12026 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:17.398403 12026 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:17.398728 12026 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:17.398783 12026 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.398826 12026 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:17.398854 12026 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.405115 12026 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:39571
I20260806 15:10:17.405174 12156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:39571 every 8 connection(s)
I20260806 15:10:17.405527 12026 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:17.413697 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12026
I20260806 15:10:17.413812 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:10:17.413988 29974 external_mini_cluster.cc:1428] Setting key 1b3dba330e1cb0963167f423fd795e48
I20260806 15:10:17.414587 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.406230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:42431 (local address 127.29.69.190:40503)
0806 15:10:17.406293 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.406295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.406522 (+ 227us) server_negotiation.cc:407] Connection header received
0806 15:10:17.407017 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.407018 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.407028 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.407080 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:17.407955 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.408446 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.409467 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.409649 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.409739 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.411758 (+ 2019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:17.411760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:17.411760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:17.411766 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:17.413125 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.413495 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.413496 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.413496 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.413576 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.413833 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.413834 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.413834 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.413997 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:17.414078 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.414406 (+ 328us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.414489 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:10:17.414800 12159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.406219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:42431)
0806 15:10:17.406417 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.406452 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.406932 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.407132 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.407135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.407692 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:17.407879 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.407884 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.408525 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.408526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.409384 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.409395 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.409744 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.409745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.409875 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.410294 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:17.410338 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:17.411678 (+ 1340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:17.413199 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.413206 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.413207 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.413430 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.413645 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.413646 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.413646 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.413744 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.414069 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:17.414077 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:17.414226 (+ 149us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.414382 (+ 156us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.414553 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":111,"threads_started":1}
I20260806 15:10:17.415258 12157 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40503
I20260806 15:10:17.415346 12157 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:17.415495 12157 heartbeater.cc:511] Master 127.29.69.190:40503 requested a full tablet report, sending...
I20260806 15:10:17.415835 11689 ts_manager.cc:194] Registered new tserver with Master: dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571)
I20260806 15:10:17.416217 11689 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:42431
I20260806 15:10:17.425807 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:10:17.432778 11729 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.427236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39540 (local address 127.29.69.190:40503)
0806 15:10:17.427302 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.427304 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.427355 (+ 51us) server_negotiation.cc:407] Connection header received
0806 15:10:17.427408 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.427408 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.427417 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.427462 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:17.427955 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.428416 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.429086 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.429260 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.429309 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.430479 (+ 1170us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:17.430480 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:17.430480 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:17.430486 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:17.431835 (+ 1349us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.432139 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.432140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.432140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.432189 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.432341 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.432341 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.432341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.432469 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:17.432543 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.432636 (+ 93us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.432692 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:10:17.434194 11689 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39540:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:10:17.435847 11689 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:10:17.442149 12170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.438140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54286 (local address 127.29.69.131:39571)
0806 15:10:17.438440 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.438446 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.438625 (+ 179us) server_negotiation.cc:407] Connection header received
0806 15:10:17.438698 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.438700 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.438718 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.438795 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:17.439050 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.439752 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.440965 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.441673 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.441717 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.441769 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.442015 (+ 246us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.442058 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":260,"thread_start_us":100,"threads_started":1}
I20260806 15:10:17.442291 12168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.438252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:42689 (local address 127.0.0.1:56036)
0806 15:10:17.438662 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.438675 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.438730 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.439046 (+ 316us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.439047 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.439049 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:17.439110 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.439112 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.440377 (+ 1265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.440378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.441283 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.441285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.442035 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.442036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.442100 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.442104 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.442160 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.442223 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":402,"mutex_wait_us":1,"thread_start_us":118,"threads_started":1}
I20260806 15:10:17.442567 12173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.438415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56036 (local address 127.29.69.130:42689)
0806 15:10:17.438584 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.438588 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.438727 (+ 139us) server_negotiation.cc:407] Connection header received
0806 15:10:17.438858 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.438860 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.438876 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.438958 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:17.439197 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.440268 (+ 1071us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.441383 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.441932 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.442029 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.442084 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.442178 (+ 94us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.442220 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":92,"threads_started":1}
I20260806 15:10:17.442581 12169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.438067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:39571 (local address 127.0.0.1:54286)
0806 15:10:17.438555 (+ 488us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.438565 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.438630 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.438891 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.438894 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.438896 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:17.438961 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.438962 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.439842 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.439842 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.440867 (+ 1025us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.440869 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.441826 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.441826 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.441902 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.441914 (+ 12us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.442458 (+ 544us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.442503 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":465,"mutex_wait_us":2,"thread_start_us":83,"threads_started":1}
I20260806 15:10:17.442709 12172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.438254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49754 (local address 127.29.69.129:44137)
0806 15:10:17.438495 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.438500 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.438702 (+ 202us) server_negotiation.cc:407] Connection header received
0806 15:10:17.438749 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.438752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.438767 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.438935 (+ 168us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:17.439128 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.440243 (+ 1115us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.441527 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.442234 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.442326 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.442382 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.442574 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.442624 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":207,"thread_start_us":117,"threads_started":1}
I20260806 15:10:17.443073 12171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.438067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44137 (local address 127.0.0.1:49754)
0806 15:10:17.438457 (+ 390us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.438496 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.438570 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.439015 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.439017 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.439019 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:17.439061 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.439062 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.440360 (+ 1298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.440361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.441434 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.441437 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.442419 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.442420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.442487 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.442490 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.442539 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.442570 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":45,"threads_started":1}
I20260806 15:10:17.443246 11953 tablet_service.cc:1467] Processing CreateTablet for tablet e01740ef6bbe4801940c78bc57a6910f (DEFAULT_TABLE table=test-table [id=e4ca759eb0ac46bb8f8575c68da149d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:17.443259 12090 tablet_service.cc:1467] Processing CreateTablet for tablet e01740ef6bbe4801940c78bc57a6910f (DEFAULT_TABLE table=test-table [id=e4ca759eb0ac46bb8f8575c68da149d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:17.443609 11953 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e01740ef6bbe4801940c78bc57a6910f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:17.443609 12090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e01740ef6bbe4801940c78bc57a6910f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:17.443775 11817 tablet_service.cc:1467] Processing CreateTablet for tablet e01740ef6bbe4801940c78bc57a6910f (DEFAULT_TABLE table=test-table [id=e4ca759eb0ac46bb8f8575c68da149d6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:17.444111 11817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e01740ef6bbe4801940c78bc57a6910f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:17.446682 12174 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap starting.
I20260806 15:10:17.447240 12175 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Bootstrap starting.
I20260806 15:10:17.447438 12174 tablet_bootstrap.cc:654] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:17.447757 12175 tablet_bootstrap.cc:654] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:17.447992 12174 log.cc:824] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:17.448163 12175 log.cc:824] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:17.448513 12176 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Bootstrap starting.
I20260806 15:10:17.448807 12174 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: No bootstrap required, opened a new log
I20260806 15:10:17.448863 12174 ts_tablet_manager.cc:1397] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:17.449091 12175 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: No bootstrap required, opened a new log
I20260806 15:10:17.449168 12176 tablet_bootstrap.cc:654] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:17.449224 12175 ts_tablet_manager.cc:1397] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:17.449743 12176 log.cc:824] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:17.450619 12176 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: No bootstrap required, opened a new log
I20260806 15:10:17.450699 12176 ts_tablet_manager.cc:1397] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:17.450692 12174 raft_consensus.cc:348] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.450862 12174 raft_consensus.cc:374] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:17.450908 12174 raft_consensus.cc:729] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219fbec6a9eb4e64a3bdec7e1a4085d3, State: Initialized, Role: FOLLOWER
I20260806 15:10:17.451022 12174 consensus_queue.cc:260] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.451313 12174 ts_tablet_manager.cc:1428] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 15:10:17.451339 11885 heartbeater.cc:503] Master 127.29.69.190:40503 was elected leader, sending a full tablet report...
I20260806 15:10:17.451287 12175 raft_consensus.cc:348] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.451434 12175 raft_consensus.cc:374] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:17.451468 12175 raft_consensus.cc:729] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dddd1c6553c046b6a6e16a80ec029252, State: Initialized, Role: FOLLOWER
I20260806 15:10:17.451570 12175 consensus_queue.cc:260] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.451859 12175 ts_tablet_manager.cc:1428] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:10:17.452044 12157 heartbeater.cc:503] Master 127.29.69.190:40503 was elected leader, sending a full tablet report...
I20260806 15:10:17.452749 12176 raft_consensus.cc:348] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.452867 12176 raft_consensus.cc:374] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:17.452895 12176 raft_consensus.cc:729] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643e0991fce7441f8755dde948bed15b, State: Initialized, Role: FOLLOWER
I20260806 15:10:17.453027 12176 consensus_queue.cc:260] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.453332 12176 ts_tablet_manager.cc:1428] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 15:10:17.453336 12021 heartbeater.cc:503] Master 127.29.69.190:40503 was elected leader, sending a full tablet report...
W20260806 15:10:17.489476 12022 tablet.cc:2369] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:10:17.565737 12181 raft_consensus.cc:482] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:17.565955 12181 raft_consensus.cc:504] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.566443 12181 leader_election.cc:288] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689), dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571)
I20260806 15:10:17.570624 12173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.566734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:36273 (local address 127.29.69.130:42689)
0806 15:10:17.566783 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.566785 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.566824 (+ 39us) server_negotiation.cc:407] Connection header received
0806 15:10:17.566853 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.566854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.566872 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.566948 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:17.567225 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.567992 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.569585 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.570211 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.570290 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.570329 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.570510 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.570554 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:10:17.570624 12170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.566775 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:60527 (local address 127.29.69.131:39571)
0806 15:10:17.566819 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.566821 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.566928 (+ 107us) server_negotiation.cc:407] Connection header received
0806 15:10:17.566984 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.566985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.566995 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.567055 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:17.567239 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.567999 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.569585 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.570211 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.570289 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.570321 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.570513 (+ 192us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.570554 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:10:17.570662 11887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.566629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:42689 (local address 127.29.69.129:36273)
0806 15:10:17.566700 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.566721 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.566777 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.566965 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.566966 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.566968 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:17.567085 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.567087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.568104 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.568105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.569491 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.569495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.570324 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.570325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.570437 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.570440 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.570494 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.570550 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":96}
I20260806 15:10:17.570667 12184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.566698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:39571 (local address 127.29.69.129:60527)
0806 15:10:17.566853 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.566868 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.566911 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.567078 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.567078 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.567079 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:17.567142 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.567143 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.568104 (+ 961us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.568105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.569491 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.569495 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.570324 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.570325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.570417 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.570423 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.570494 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.570549 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":106,"thread_start_us":85,"threads_started":1}
I20260806 15:10:17.571017 11974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e01740ef6bbe4801940c78bc57a6910f" candidate_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643e0991fce7441f8755dde948bed15b" is_pre_election: true
I20260806 15:10:17.571071 12111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e01740ef6bbe4801940c78bc57a6910f" candidate_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dddd1c6553c046b6a6e16a80ec029252" is_pre_election: true
I20260806 15:10:17.571180 11974 raft_consensus.cc:2454] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 219fbec6a9eb4e64a3bdec7e1a4085d3 in term 0.
I20260806 15:10:17.571256 12111 raft_consensus.cc:2454] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 219fbec6a9eb4e64a3bdec7e1a4085d3 in term 0.
I20260806 15:10:17.571465 11769 leader_election.cc:302] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3, 643e0991fce7441f8755dde948bed15b; no voters:
I20260806 15:10:17.571610 12181 raft_consensus.cc:2781] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:10:17.571676 12181 raft_consensus.cc:482] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:10:17.571694 12181 raft_consensus.cc:3037] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:17.572441 12181 raft_consensus.cc:504] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.572582 12181 leader_election.cc:288] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 1 election: Requested vote from peers 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689), dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571)
I20260806 15:10:17.572736 11974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e01740ef6bbe4801940c78bc57a6910f" candidate_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643e0991fce7441f8755dde948bed15b"
I20260806 15:10:17.572767 12111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e01740ef6bbe4801940c78bc57a6910f" candidate_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dddd1c6553c046b6a6e16a80ec029252"
I20260806 15:10:17.572829 12111 raft_consensus.cc:3037] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:17.572824 11974 raft_consensus.cc:3037] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:17.573721 12111 raft_consensus.cc:2454] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 219fbec6a9eb4e64a3bdec7e1a4085d3 in term 1.
I20260806 15:10:17.573721 11974 raft_consensus.cc:2454] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 219fbec6a9eb4e64a3bdec7e1a4085d3 in term 1.
I20260806 15:10:17.573876 11769 leader_election.cc:302] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3, 643e0991fce7441f8755dde948bed15b; no voters:
I20260806 15:10:17.573961 12181 raft_consensus.cc:2781] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:17.574147 12181 raft_consensus.cc:686] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 LEADER]: Becoming Leader. State: Replica: 219fbec6a9eb4e64a3bdec7e1a4085d3, State: Running, Role: LEADER
W20260806 15:10:17.574148 11886 tablet.cc:2369] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:10:17.574323 12181 consensus_queue.cc:237] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.575246 11688 catalog_manager.cc:5495] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } health_report { overall_health: UNKNOWN } } }
I20260806 15:10:17.590875 12172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.588595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49768 (local address 127.29.69.129:44137)
0806 15:10:17.588656 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.588658 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.588666 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:17.588733 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.588734 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.588748 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.588805 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:17.588959 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.589412 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.590159 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.590414 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.590473 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.590615 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:17.590702 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:10:17.590756 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.590789 (+ 33us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.590804 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:10:17.592600 11974 raft_consensus.cc:1261] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Refusing update from remote peer 219fbec6a9eb4e64a3bdec7e1a4085d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:17.592610 12111 raft_consensus.cc:1261] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Refusing update from remote peer 219fbec6a9eb4e64a3bdec7e1a4085d3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:17.593044 12181 consensus_queue.cc:1035] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:17.593194 12185 consensus_queue.cc:1035] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:17.595693 12189 mvcc.cc:205] Tried to move back new op lower bound from 7315574856056676352 to 7315574855985139712. Current Snapshot: MvccSnapshot[applied={T|T < 7315574856056676352}]
I20260806 15:10:17.596093 12190 mvcc.cc:205] Tried to move back new op lower bound from 7315574856056676352 to 7315574855985139712. Current Snapshot: MvccSnapshot[applied={T|T < 7315574856056676352}]
I20260806 15:10:17.597519 11688 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:17.597600 11688 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39540:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:17.598402 11688 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Sending DeleteTablet for 3 replicas of tablet e01740ef6bbe4801940c78bc57a6910f
I20260806 15:10:17.598695 11817 tablet_service.cc:1514] Processing DeleteTablet for tablet e01740ef6bbe4801940c78bc57a6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:17 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:49754
I20260806 15:10:17.598709 12090 tablet_service.cc:1514] Processing DeleteTablet for tablet e01740ef6bbe4801940c78bc57a6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:17 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:54286
I20260806 15:10:17.598950 11953 tablet_service.cc:1514] Processing DeleteTablet for tablet e01740ef6bbe4801940c78bc57a6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:17 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56036
I20260806 15:10:17.599193 12200 tablet_replica.cc:330] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: stopping tablet replica
I20260806 15:10:17.599272 12198 tablet_replica.cc:330] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: stopping tablet replica
I20260806 15:10:17.599285 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11752
I20260806 15:10:17.599366 12198 raft_consensus.cc:2229] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:10:17.599496 12198 raft_consensus.cc:2258] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:17.602469 12199 tablet_replica.cc:330] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: stopping tablet replica
I20260806 15:10:17.602569 12199 raft_consensus.cc:2229] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:17.602664 12199 raft_consensus.cc:2258] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:17.603169 12199 ts_tablet_manager.cc:1905] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:17.603842 12200 raft_consensus.cc:2229] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:17.603973 12200 raft_consensus.cc:2258] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:17.604430 12200 ts_tablet_manager.cc:1905] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:17.604945 12199 ts_tablet_manager.cc:1918] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:17.605020 12199 log.cc:1196] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/e01740ef6bbe4801940c78bc57a6910f
I20260806 15:10:17.605315 12199 ts_tablet_manager.cc:1939] T e01740ef6bbe4801940c78bc57a6910f P dddd1c6553c046b6a6e16a80ec029252: Deleting consensus metadata
I20260806 15:10:17.605757 11673 catalog_manager.cc:4841] TS dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): tablet e01740ef6bbe4801940c78bc57a6910f (table test-table [id=e4ca759eb0ac46bb8f8575c68da149d6]) successfully deleted
I20260806 15:10:17.606070 12200 ts_tablet_manager.cc:1918] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:17.606129 12200 log.cc:1196] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/e01740ef6bbe4801940c78bc57a6910f
I20260806 15:10:17.606454 12200 ts_tablet_manager.cc:1939] T e01740ef6bbe4801940c78bc57a6910f P 643e0991fce7441f8755dde948bed15b: Deleting consensus metadata
I20260806 15:10:17.606823 11674 catalog_manager.cc:4841] TS 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): tablet e01740ef6bbe4801940c78bc57a6910f (table test-table [id=e4ca759eb0ac46bb8f8575c68da149d6]) successfully deleted
W20260806 15:10:17.608848 11674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:44137 (error 108)
I20260806 15:10:17.609117 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11890
I20260806 15:10:17.610221 12171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.610103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44137 (local address 127.0.0.1:49774)
0806 15:10:17.610148 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.610188 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:44137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260806 15:10:17.610399 11674 catalog_manager.cc:4584] TS 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e01740ef6bbe4801940c78bc57a6910f: Network error: Client connection negotiation failed: client connection to 127.29.69.129:44137: connect: Connection refused (error 111)
I20260806 15:10:17.624449 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12026
I20260806 15:10:17.630071 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 11656
I20260806 15:10:17.635915 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40503
--webserver_interface=127.29.69.190
--webserver_port=44955
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:40503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:17.717157 12202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:17.717358 12202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:17.717381 12202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:17.718573 12202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:17.718609 12202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:17.718623 12202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:17.718639 12202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:17.718652 12202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:17.720074 12202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:40503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=44955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:17.720316 12202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:17.720575 12202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:17.729686 12209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.729657 12208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.729861 12211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:17.729780 12202 server_base.cc:1034] running on GCE node
I20260806 15:10:17.730165 12202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:17.730512 12202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:17.731659 12202 hybrid_clock.cc:648] HybridClock initialized: now 1786029017731650 us; error 33 us; skew 500 ppm
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:17.734028 12202 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:17.734493 12202 webserver.cc:460] Webserver started at http://127.29.69.190:44955/ using document root <none> and password file <none>
I20260806 15:10:17.734715 12202 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:17.734771 12202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:17.736049 12202 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:17.736701 12218 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.736879 12202 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:17.736970 12202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "70d00687b4574084b4ebd73b72c07f03"
format_stamp: "Formatted at 2026-08-06 15:10:16 on dist-test-slave-tm1g"
server_key: "7f2150a4390773f7af763f09b00d7b7c"
server_key_iv: "8172415c0617a0bd748822cb168feca2"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.737370 12202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:17.764410 12202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:17.766440 12202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:17.766566 12202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:17.770421 12202 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:40503
I20260806 15:10:17.770484 12271 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:40503 every 8 connection(s)
I20260806 15:10:17.770846 12202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:17.771034 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12202
I20260806 15:10:17.771353 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:44137
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:40503
--webserver_port=38741
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:17.772531 12272 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:10:17.773208 12272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap starting.
I20260806 15:10:17.785213 12272 log.cc:824] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:17.787935 12272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:17.788305 12272 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap complete.
I20260806 15:10:17.791668 12272 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:17.791973 12272 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d00687b4574084b4ebd73b72c07f03, State: Initialized, Role: FOLLOWER
I20260806 15:10:17.792127 12272 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:17.792193 12272 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:17.792243 12272 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:17.792289 12272 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:10:17.793740 12272 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:17.793849 12272 leader_election.cc:302] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70d00687b4574084b4ebd73b72c07f03; no voters:
I20260806 15:10:17.794013 12272 leader_election.cc:288] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 15:10:17.794092 12276 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:10:17.794260 12272 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:17.794265 12276 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 LEADER]: Becoming Leader. State: Replica: 70d00687b4574084b4ebd73b72c07f03, State: Running, Role: LEADER
I20260806 15:10:17.794535 12276 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:17.794773 12276 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70d00687b4574084b4ebd73b72c07f03. Latest consensus state: current_term: 2 leader_uuid: "70d00687b4574084b4ebd73b72c07f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } } }
I20260806 15:10:17.794878 12276 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:17.794775 12277 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "70d00687b4574084b4ebd73b72c07f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } } }
I20260806 15:10:17.795053 12277 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:17.795167 12285 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:17.795998 12285 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:17.796118 12285 catalog_manager.cc:1259] Loaded cluster ID: bb67029c486c4eafa4398bc10e7ed262
I20260806 15:10:17.796154 12285 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:17.796510 12285 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260806 15:10:17.801265 12285 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260806 15:10:17.803671 12285 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:17.803861 12285 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Loaded TSK: 0
I20260806 15:10:17.804078 12285 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:10:17.864936 12274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:17.865170 12274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:17.865208 12274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:17.866375 12274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:17.866448 12274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:17.866497 12274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:17.867955 12274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:44137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=38741
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:17.868211 12274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:17.868444 12274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:17.874444 12299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.874424 12302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:17.874410 12300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:17.874617 12274 server_base.cc:1034] running on GCE node
I20260806 15:10:17.875031 12274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:17.875296 12274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:17.876477 12274 hybrid_clock.cc:648] HybridClock initialized: now 1786029017876465 us; error 35 us; skew 500 ppm
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:17.879176 12274 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:17.879693 12274 webserver.cc:460] Webserver started at http://127.29.69.129:38741/ using document root <none> and password file <none>
I20260806 15:10:17.879945 12274 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:17.880029 12274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:17.881858 12274 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:10:17.882679 12309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:17.882879 12274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:17.882978 12274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "c64984ba4378ebd1677ffbfc4b5ba8b1"
server_key_iv: "e96403ccb7d52c80d62d4c809ea61778"
server_key_version: "encryptionkey@0"
I20260806 15:10:17.883438 12274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:17.896979 12274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:17.899519 12274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:17.899682 12274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:17.899940 12274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:17.900471 12316 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:10:17.901914 12274 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:10:17.901976 12274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 15:10:17.902010 12274 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:10:17.902941 12274 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:10:17.902989 12274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:17.903108 12316 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap starting.
I20260806 15:10:17.910282 12274 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:44137
I20260806 15:10:17.910588 12424 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:44137 every 8 connection(s)
I20260806 15:10:17.910769 12274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:10:17.914085 12316 log.cc:824] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:17.916832 12316 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:17.917138 12316 tablet_bootstrap.cc:492] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap complete.
I20260806 15:10:17.918294 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12274
I20260806 15:10:17.918483 12316 ts_tablet_manager.cc:1397] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.015s
I20260806 15:10:17.918623 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:42689
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:40503
--webserver_port=37251
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 15:10:17 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029017, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:17.920573 12316 raft_consensus.cc:348] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.920905 12316 raft_consensus.cc:729] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219fbec6a9eb4e64a3bdec7e1a4085d3, State: Initialized, Role: FOLLOWER
I20260806 15:10:17.921052 12316 consensus_queue.cc:260] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } }
I20260806 15:10:17.921327 12316 ts_tablet_manager.cc:1428] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260806 15:10:17.926806 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.911652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:43881 (local address 127.29.69.190:40503)
0806 15:10:17.913097 (+ 1445us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.913107 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.913150 (+ 43us) server_negotiation.cc:407] Connection header received
0806 15:10:17.913308 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.913316 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.913408 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.913570 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:17.914507 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.915486 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.916598 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.917067 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.917196 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.921935 (+ 4739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:17.921939 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:17.921939 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:17.921951 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:17.924526 (+ 2575us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.925054 (+ 528us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.925058 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.925058 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.925189 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:17.925491 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:17.925492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:17.925492 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:17.925822 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:17.925915 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.926363 (+ 448us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.926541 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1382,"thread_start_us":84,"threads_started":1}
I20260806 15:10:17.927691 12427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.911549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:43881)
0806 15:10:17.911869 (+ 320us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.911918 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.912727 (+ 809us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.913626 (+ 899us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.913630 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.913992 (+ 362us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:17.914258 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.914264 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.915615 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.915616 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.916505 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.916508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.917231 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.917233 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.917407 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.917995 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:17.918004 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:17.921813 (+ 3809us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:17.924641 (+ 2828us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.924648 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.924650 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.924942 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.925272 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:17.925273 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:17.925273 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:17.925414 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:17.925949 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:17.925957 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:17.926122 (+ 165us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.927233 (+ 1111us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.927452 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":100,"threads_started":1}
I20260806 15:10:17.928746 12425 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40503
I20260806 15:10:17.928844 12425 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:17.929034 12425 heartbeater.cc:511] Master 127.29.69.190:40503 requested a full tablet report, sending...
I20260806 15:10:17.929953 12235 ts_manager.cc:194] Registered new tserver with Master: 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137)
I20260806 15:10:17.931439 12235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:43881
I20260806 15:10:17.932466 12425 heartbeater.cc:503] Master 127.29.69.190:40503 was elected leader, sending a full tablet report...
I20260806 15:10:17.938609 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.930770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44137 (local address 127.0.0.1:49782)
0806 15:10:17.934442 (+ 3672us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:17.934480 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:17.934544 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:17.934822 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:17.934825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:17.934828 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:17.934889 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.934891 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.936118 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.936119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.937395 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:17.937398 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.938286 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.938287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:17.938400 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.938413 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 15:10:17.938483 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:10:17.938534 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3632,"thread_start_us":120,"threads_started":1}
I20260806 15:10:17.938613 12433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:17.931091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49782 (local address 127.29.69.129:44137)
0806 15:10:17.934670 (+ 3579us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:17.934674 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:17.934682 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:17.934714 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:17.934716 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:17.934731 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:17.934801 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:17.934964 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.936038 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.937488 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:17.938201 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:17.938277 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:17.938350 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:17.938505 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 15:10:17.938548 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3547,"thread_start_us":85,"threads_started":1}
I20260806 15:10:17.939216 12358 tablet_service.cc:1514] Processing DeleteTablet for tablet e01740ef6bbe4801940c78bc57a6910f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:17 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:49782
I20260806 15:10:17.939796 12434 tablet_replica.cc:330] stopping tablet replica
I20260806 15:10:17.939898 12434 raft_consensus.cc:2229] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:17.939960 12434 raft_consensus.cc:2258] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:17.940296 12434 ts_tablet_manager.cc:1905] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:17.942588 12434 ts_tablet_manager.cc:1918] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:17.942734 12434 log.cc:1196] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/e01740ef6bbe4801940c78bc57a6910f
I20260806 15:10:17.942999 12434 ts_tablet_manager.cc:1939] T e01740ef6bbe4801940c78bc57a6910f P 219fbec6a9eb4e64a3bdec7e1a4085d3: Deleting consensus metadata
I20260806 15:10:17.943486 12220 catalog_manager.cc:4841] TS 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137): tablet e01740ef6bbe4801940c78bc57a6910f (table test-table [id=e4ca759eb0ac46bb8f8575c68da149d6]) successfully deleted
W20260806 15:10:18.005293 12430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:18.005546 12430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:18.005587 12430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:18.006752 12430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:18.006814 12430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:18.006857 12430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:10:18.008356 12430 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:42689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=37251
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:18.008806 12430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:18.009063 12430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:18.013980 12440 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.014001 12439 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.014235 12430 server_base.cc:1034] running on GCE node
W20260806 15:10:18.013954 12442 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.014464 12430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:18.014668 12430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:18.015841 12430 hybrid_clock.cc:648] HybridClock initialized: now 1786029018015828 us; error 28 us; skew 500 ppm
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:18.018445 12430 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:18.018893 12430 webserver.cc:460] Webserver started at http://127.29.69.130:37251/ using document root <none> and password file <none>
I20260806 15:10:18.019151 12430 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:18.019208 12430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:18.020572 12430 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:18.021163 12449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.021332 12430 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:18.021420 12430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "643e0991fce7441f8755dde948bed15b"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "22538ee96237ec3dd4b68d756039eb9d"
server_key_iv: "447481b8f85f290cbeb64b1c5799f542"
server_key_version: "encryptionkey@0"
I20260806 15:10:18.021734 12430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:18.036046 12430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:18.037729 12430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:18.037837 12430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:18.038009 12430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:18.038357 12430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:18.038401 12430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.038450 12430 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:18.038476 12430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.044524 12430 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:42689
I20260806 15:10:18.044607 12564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:42689 every 8 connection(s)
I20260806 15:10:18.044946 12430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:18.054283 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12430
I20260806 15:10:18.054339 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.045702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:48399 (local address 127.29.69.190:40503)
0806 15:10:18.045766 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.045768 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.045968 (+ 200us) server_negotiation.cc:407] Connection header received
0806 15:10:18.046549 (+ 581us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.046551 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.046562 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.046615 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:18.047538 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.048043 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.049041 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.049254 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.049339 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.051865 (+ 2526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:18.051867 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:18.051867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:18.051873 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:18.053073 (+ 1200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:18.053463 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:18.053464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:18.053464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:18.053523 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:18.053730 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:18.053731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:18.053731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:18.053827 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:18.053875 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.054119 (+ 244us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.054215 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:10:18.054445 12567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.045707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:48399)
0806 15:10:18.045853 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.045888 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.046448 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.046687 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:18.046690 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:18.047240 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:18.047418 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.047422 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.048140 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.048141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.048929 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.048930 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.049352 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.049353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.049484 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.049981 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:18.049989 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:18.051780 (+ 1791us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:18.053155 (+ 1375us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:18.053162 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:18.053164 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:18.053394 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:18.053579 (+ 185us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:18.053580 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:18.053580 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:18.053677 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:18.053882 (+ 205us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:18.053887 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:18.053992 (+ 105us) client_negotiation.cc:769] Sending connection context
0806 15:10:18.054073 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 15:10:18.054187 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":70,"threads_started":1}
I20260806 15:10:18.054631 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:39571
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:40503
--webserver_port=34345
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:18.054955 12565 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40503
I20260806 15:10:18.055034 12565 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:18.055217 12565 heartbeater.cc:511] Master 127.29.69.190:40503 requested a full tablet report, sending...
I20260806 15:10:18.055598 12235 ts_manager.cc:194] Registered new tserver with Master: 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
I20260806 15:10:18.055939 12235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:48399
W20260806 15:10:18.136720 12568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:18.136911 12568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:18.136936 12568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:18.138590 12568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:18.138643 12568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:18.138710 12568 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:18.140168 12568 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:39571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=34345
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:18.140391 12568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:18.140652 12568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:18.145710 12573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.145716 12574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.145709 12576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.145991 12568 server_base.cc:1034] running on GCE node
I20260806 15:10:18.146194 12568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:18.146452 12568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:18.147593 12568 hybrid_clock.cc:648] HybridClock initialized: now 1786029018147569 us; error 40 us; skew 500 ppm
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:18.150101 12568 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:18.150569 12568 webserver.cc:460] Webserver started at http://127.29.69.131:34345/ using document root <none> and password file <none>
I20260806 15:10:18.150791 12568 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:18.150944 12568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:18.152235 12568 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:18.152787 12583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.152981 12568 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:18.153087 12568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "dddd1c6553c046b6a6e16a80ec029252"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "3117901924369abc1b4dde09d7537462"
server_key_iv: "271dc3307c018f193e3e744abc648c5e"
server_key_version: "encryptionkey@0"
I20260806 15:10:18.153412 12568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:18.160524 12568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:18.162722 12568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:18.162874 12568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:18.163100 12568 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:18.163391 12568 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:18.163443 12568 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.163475 12568 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:18.163504 12568 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.169198 12568 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:39571
I20260806 15:10:18.169273 12698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:39571 every 8 connection(s)
I20260806 15:10:18.169617 12568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:18.178088 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.170374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:46183 (local address 127.29.69.190:40503)
0806 15:10:18.170463 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.170466 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.170620 (+ 154us) server_negotiation.cc:407] Connection header received
0806 15:10:18.171094 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.171095 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.171104 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.171159 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:18.172032 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.172532 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.173472 (+ 940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.173659 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.173714 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.175659 (+ 1945us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:18.175660 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:18.175660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:18.175667 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:18.176844 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:18.177204 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:18.177205 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:18.177205 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:18.177256 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:18.177507 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:18.177509 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:18.177509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:18.177634 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:18.177700 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.177939 (+ 239us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.178014 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:10:18.178193 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.170289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:46183)
0806 15:10:18.170493 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.170534 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.171012 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.171208 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:18.171211 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:18.171751 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:18.171933 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.171937 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.172611 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.172612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.173380 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.173382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.173734 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.173735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.173834 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.174236 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:18.174244 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:18.175572 (+ 1328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:18.176917 (+ 1345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:18.176924 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:18.176926 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:18.177140 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:18.177313 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:18.177313 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:18.177314 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:18.177405 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:18.177699 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:18.177704 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:18.177824 (+ 120us) client_negotiation.cc:769] Sending connection context
0806 15:10:18.177904 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 15:10:18.178023 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":97,"threads_started":1}
I20260806 15:10:18.178720 12699 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40503
I20260806 15:10:18.178798 12699 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:18.178996 12699 heartbeater.cc:511] Master 127.29.69.190:40503 requested a full tablet report, sending...
I20260806 15:10:18.179381 12235 ts_manager.cc:194] Registered new tserver with Master: dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571)
I20260806 15:10:18.179808 12235 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:46183
I20260806 15:10:18.179808 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12568
I20260806 15:10:18.186270 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.180316 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39556 (local address 127.29.69.190:40503)
0806 15:10:18.180461 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.180463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.180473 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:18.180533 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.180534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.180544 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.180593 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:18.181152 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.181614 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.182408 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.182606 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.182682 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.183843 (+ 1161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:18.183845 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:18.183845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:18.183852 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:18.185150 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:18.185506 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:18.185507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:18.185507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:18.185568 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:18.185765 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:18.185766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:18.185766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:18.185872 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:18.186061 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.186098 (+ 37us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.186171 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260806 15:10:18.187098 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:10:18.189881 12428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.187488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39572 (local address 127.29.69.190:40503)
0806 15:10:18.187563 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.187565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.187623 (+ 58us) server_negotiation.cc:407] Connection header received
0806 15:10:18.187706 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.187707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.187746 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.187817 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:18.187936 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.188395 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.189156 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.189345 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.189426 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.189595 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:18.189685 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:10:18.189773 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.189795 (+ 22us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.189812 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 15:10:18.190160 12235 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:39572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:10:18.191823 12235 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:10:18.194415 12358 tablet_service.cc:1467] Processing CreateTablet for tablet 19a0b24f9d4e44149b290fcc617ec5f2 (DEFAULT_TABLE table=test-table [id=2a2866290cba4f6f8ff4e0b84b762d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:18.194667 12358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a0b24f9d4e44149b290fcc617ec5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:18.196811 12316 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap starting.
I20260806 15:10:18.197162 12316 tablet_bootstrap.cc:654] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:18.197755 12316 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: No bootstrap required, opened a new log
I20260806 15:10:18.197805 12316 ts_tablet_manager.cc:1397] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:18.197876 12705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.193979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:42689 (local address 127.0.0.1:56038)
0806 15:10:18.194081 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.194130 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.194178 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.194528 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:18.194529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:18.194531 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:18.194600 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.194602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.195986 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.195987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.196806 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.196809 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.197634 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.197635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.197700 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.197705 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:10:18.197762 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 15:10:18.197806 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":65,"threads_started":1}
I20260806 15:10:18.197966 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.193792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:39571 (local address 127.0.0.1:54300)
0806 15:10:18.193844 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.193855 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.193892 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.194244 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:18.194245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:18.194246 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:18.194282 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.194283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.195827 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.195828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.196668 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.196670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.197750 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.197751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.197818 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.197822 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:18.197856 (+ 34us) client_negotiation.cc:240] Negotiation successful
0806 15:10:18.197899 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 15:10:18.197933 12316 raft_consensus.cc:348] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.197899 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.194083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56038 (local address 127.29.69.130:42689)
0806 15:10:18.194372 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.194376 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.194387 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:10:18.194429 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.194431 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.194448 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.194533 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:18.194697 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.195895 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.196938 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.197562 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.197634 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.197691 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.197776 (+ 85us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.197812 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":258,"thread_start_us":91,"threads_started":1}
I20260806 15:10:18.198006 12316 raft_consensus.cc:374] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:18.198055 12316 raft_consensus.cc:729] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219fbec6a9eb4e64a3bdec7e1a4085d3, State: Initialized, Role: FOLLOWER
I20260806 15:10:18.198113 12316 consensus_queue.cc:260] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.198223 12316 ts_tablet_manager.cc:1428] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.198534 12704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.193885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.29.69.131:39571)
0806 15:10:18.194057 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.194062 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.194072 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:18.194114 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.194116 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.194132 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.194423 (+ 291us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:18.194503 (+ 80us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.195725 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.196763 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.197646 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.198287 (+ 641us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.198377 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.198406 (+ 29us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.198453 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":101,"threads_started":1}
I20260806 15:10:18.198930 12497 tablet_service.cc:1467] Processing CreateTablet for tablet 19a0b24f9d4e44149b290fcc617ec5f2 (DEFAULT_TABLE table=test-table [id=2a2866290cba4f6f8ff4e0b84b762d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:18.199121 12631 tablet_service.cc:1467] Processing CreateTablet for tablet 19a0b24f9d4e44149b290fcc617ec5f2 (DEFAULT_TABLE table=test-table [id=2a2866290cba4f6f8ff4e0b84b762d6e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:18.199301 12497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a0b24f9d4e44149b290fcc617ec5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:18.199414 12631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19a0b24f9d4e44149b290fcc617ec5f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:18.202845 12709 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Bootstrap starting.
I20260806 15:10:18.203013 12708 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Bootstrap starting.
I20260806 15:10:18.203619 12709 tablet_bootstrap.cc:654] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:18.203624 12708 tablet_bootstrap.cc:654] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:18.204231 12708 log.cc:824] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:18.204231 12709 log.cc:824] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:18.205046 12709 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: No bootstrap required, opened a new log
I20260806 15:10:18.205127 12709 ts_tablet_manager.cc:1397] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:18.205371 12708 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: No bootstrap required, opened a new log
I20260806 15:10:18.205440 12708 ts_tablet_manager.cc:1397] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:10:18.207145 12709 raft_consensus.cc:348] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.207319 12709 raft_consensus.cc:374] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:18.207369 12709 raft_consensus.cc:729] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 643e0991fce7441f8755dde948bed15b, State: Initialized, Role: FOLLOWER
I20260806 15:10:18.207360 12708 raft_consensus.cc:348] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.207507 12708 raft_consensus.cc:374] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:18.207551 12708 raft_consensus.cc:729] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dddd1c6553c046b6a6e16a80ec029252, State: Initialized, Role: FOLLOWER
I20260806 15:10:18.207523 12709 consensus_queue.cc:260] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.207679 12708 consensus_queue.cc:260] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.207789 12709 ts_tablet_manager.cc:1428] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:10:18.207945 12708 ts_tablet_manager.cc:1428] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 15:10:18.207948 12565 heartbeater.cc:503] Master 127.29.69.190:40503 was elected leader, sending a full tablet report...
I20260806 15:10:18.208079 12699 heartbeater.cc:503] Master 127.29.69.190:40503 was elected leader, sending a full tablet report...
W20260806 15:10:18.295552 12566 tablet.cc:2369] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:10:18.360530 12713 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:18.360658 12713 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.361002 12713 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689), 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137)
I20260806 15:10:18.364284 12701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.361225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:42689 (local address 127.29.69.131:59149)
0806 15:10:18.361284 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.361297 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.361346 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.361595 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:18.361596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:18.361598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:18.361665 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.361667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.362501 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.362502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.363361 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.363364 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.364003 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.364004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.364093 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.364097 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:18.364155 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 15:10:18.364188 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35,"mutex_wait_us":30}
I20260806 15:10:18.364298 12706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.361381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:59149 (local address 127.29.69.130:42689)
0806 15:10:18.361435 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.361438 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.361448 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:18.361478 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.361479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.361490 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.361586 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:18.361738 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.362428 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.363486 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.363926 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.363985 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.363992 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.364175 (+ 183us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.364227 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260806 15:10:18.364404 12433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.361451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:43895 (local address 127.29.69.129:44137)
0806 15:10:18.361529 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.361531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.361663 (+ 132us) server_negotiation.cc:407] Connection header received
0806 15:10:18.361783 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.361785 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.361793 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.361836 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:18.362014 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.362591 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.363627 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.364008 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.364079 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.364087 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.364268 (+ 181us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.364321 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 15:10:18.364428 12714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.361395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44137 (local address 127.29.69.131:43895)
0806 15:10:18.361602 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.361614 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.361675 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.361862 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:18.361863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:18.361865 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:18.361942 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.361944 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.362714 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.362715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.363534 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:18.363536 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.364094 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.364095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:18.364181 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.364186 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:10:18.364243 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 15:10:18.364280 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":124,"threads_started":1}
I20260806 15:10:18.364806 12517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a0b24f9d4e44149b290fcc617ec5f2" candidate_uuid: "dddd1c6553c046b6a6e16a80ec029252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643e0991fce7441f8755dde948bed15b" is_pre_election: true
I20260806 15:10:18.365032 12517 raft_consensus.cc:2454] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dddd1c6553c046b6a6e16a80ec029252 in term 0.
I20260806 15:10:18.365171 12378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a0b24f9d4e44149b290fcc617ec5f2" candidate_uuid: "dddd1c6553c046b6a6e16a80ec029252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" is_pre_election: true
I20260806 15:10:18.365301 12585 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 643e0991fce7441f8755dde948bed15b, dddd1c6553c046b6a6e16a80ec029252; no voters:
I20260806 15:10:18.365348 12378 raft_consensus.cc:2454] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate dddd1c6553c046b6a6e16a80ec029252 in term 0.
I20260806 15:10:18.365466 12713 raft_consensus.cc:2781] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:10:18.365543 12713 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:10:18.365571 12713 raft_consensus.cc:3037] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:18.366276 12713 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.366444 12713 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [CANDIDATE]: Term 1 election: Requested vote from peers 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689), 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137)
I20260806 15:10:18.366618 12517 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a0b24f9d4e44149b290fcc617ec5f2" candidate_uuid: "dddd1c6553c046b6a6e16a80ec029252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "643e0991fce7441f8755dde948bed15b"
I20260806 15:10:18.366648 12378 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19a0b24f9d4e44149b290fcc617ec5f2" candidate_uuid: "dddd1c6553c046b6a6e16a80ec029252" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3"
I20260806 15:10:18.366719 12517 raft_consensus.cc:3037] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:18.366748 12378 raft_consensus.cc:3037] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:18.367440 12378 raft_consensus.cc:2454] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dddd1c6553c046b6a6e16a80ec029252 in term 1.
I20260806 15:10:18.367506 12517 raft_consensus.cc:2454] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate dddd1c6553c046b6a6e16a80ec029252 in term 1.
I20260806 15:10:18.367605 12585 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3, dddd1c6553c046b6a6e16a80ec029252; no voters:
I20260806 15:10:18.367694 12713 raft_consensus.cc:2781] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:18.367859 12713 raft_consensus.cc:686] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 1 LEADER]: Becoming Leader. State: Replica: dddd1c6553c046b6a6e16a80ec029252, State: Running, Role: LEADER
I20260806 15:10:18.367972 12713 consensus_queue.cc:237] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.368839 12235 catalog_manager.cc:5495] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 reported cstate change: term changed from 0 to 1, leader changed from <none> to dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131). New cstate: current_term: 1 leader_uuid: "dddd1c6553c046b6a6e16a80ec029252" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } health_report { overall_health: UNKNOWN } } }
I20260806 15:10:18.384359 12704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.382011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40418 (local address 127.29.69.131:39571)
0806 15:10:18.382078 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:18.382079 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:18.382087 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:18.382119 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:18.382120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:18.382135 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:18.382193 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:18.382444 (+ 251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.382970 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.383678 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:18.383867 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:18.383919 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:18.384043 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:18.384130 (+ 87us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:10:18.384186 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:18.384216 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 15:10:18.384234 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260806 15:10:18.386121 12378 raft_consensus.cc:1261] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Refusing update from remote peer dddd1c6553c046b6a6e16a80ec029252: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:18.386122 12517 raft_consensus.cc:1261] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Refusing update from remote peer dddd1c6553c046b6a6e16a80ec029252: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:18.386492 12713 consensus_queue.cc:1035] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:18.386632 12715 consensus_queue.cc:1035] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [LEADER]: Connected to new peer: Peer: permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:18.389691 12720 mvcc.cc:205] Tried to move back new op lower bound from 7315574859306930176 to 7315574859235991552. Current Snapshot: MvccSnapshot[applied={T|T < 7315574859306930176 or (T in {7315574859306930176})}]
I20260806 15:10:18.391114 12233 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:39572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:18.391211 12233 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:39572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:18.391934 12233 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Sending DeleteTablet for 3 replicas of tablet 19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:18.392261 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12274
I20260806 15:10:18.392248 12631 tablet_service.cc:1514] Processing DeleteTablet for tablet 19a0b24f9d4e44149b290fcc617ec5f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:18 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:54300
I20260806 15:10:18.399557 12727 tablet_replica.cc:330] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: stopping tablet replica
I20260806 15:10:18.399546 12497 tablet_service.cc:1514] Processing DeleteTablet for tablet 19a0b24f9d4e44149b290fcc617ec5f2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:18 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56038
I20260806 15:10:18.399761 12727 raft_consensus.cc:2229] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:10:18.399788 12728 tablet_replica.cc:330] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: stopping tablet replica
I20260806 15:10:18.399885 12728 raft_consensus.cc:2229] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:18.399989 12727 raft_consensus.cc:2258] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:18.400005 12728 raft_consensus.cc:2258] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:18.400486 12728 ts_tablet_manager.cc:1905] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:18.400678 12727 ts_tablet_manager.cc:1905] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:18.402205 12728 ts_tablet_manager.cc:1918] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:18.402287 12728 log.cc:1196] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:18.402621 12728 ts_tablet_manager.cc:1939] T 19a0b24f9d4e44149b290fcc617ec5f2 P 643e0991fce7441f8755dde948bed15b: Deleting consensus metadata
I20260806 15:10:18.402995 12727 ts_tablet_manager.cc:1918] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:18.403030 12220 catalog_manager.cc:4841] TS 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): tablet 19a0b24f9d4e44149b290fcc617ec5f2 (table test-table [id=2a2866290cba4f6f8ff4e0b84b762d6e]) successfully deleted
I20260806 15:10:18.403151 12727 log.cc:1196] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:18.403472 12727 ts_tablet_manager.cc:1939] T 19a0b24f9d4e44149b290fcc617ec5f2 P dddd1c6553c046b6a6e16a80ec029252: Deleting consensus metadata
I20260806 15:10:18.403877 12219 catalog_manager.cc:4841] TS dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): tablet 19a0b24f9d4e44149b290fcc617ec5f2 (table test-table [id=2a2866290cba4f6f8ff4e0b84b762d6e]) successfully deleted
W20260806 15:10:18.404102 12220 connection.cc:535] client connection to 127.29.69.129:44137 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260806 15:10:18.404176 12220 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:10:18.404230 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12430
I20260806 15:10:18.408439 12432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.408280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44137 (local address 127.0.0.1:60544)
0806 15:10:18.408345 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.408405 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:44137: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260806 15:10:18.408550 12220 catalog_manager.cc:4584] TS 219fbec6a9eb4e64a3bdec7e1a4085d3 (127.29.69.129:44137): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 19a0b24f9d4e44149b290fcc617ec5f2: Network error: Client connection negotiation failed: client connection to 127.29.69.129:44137: connect: Connection refused (error 111)
I20260806 15:10:18.412038 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12568
I20260806 15:10:18.417178 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12202
I20260806 15:10:18.423131 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40503
--webserver_interface=127.29.69.190
--webserver_port=44955
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:40503
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:18.504146 12730 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:18.504339 12730 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:18.504362 12730 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:18.505429 12730 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:18.505461 12730 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:18.505475 12730 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:18.505488 12730 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:18.505501 12730 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:18.506904 12730 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:40503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=44955
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12730
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:18.507085 12730 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:18.507282 12730 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:18.512159 12736 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.512151 12735 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.512151 12738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.512185 12730 server_base.cc:1034] running on GCE node
I20260806 15:10:18.512641 12730 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:18.512897 12730 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:18.514066 12730 hybrid_clock.cc:648] HybridClock initialized: now 1786029018514059 us; error 37 us; skew 500 ppm
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:18.516618 12730 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:18.517143 12730 webserver.cc:460] Webserver started at http://127.29.69.190:44955/ using document root <none> and password file <none>
I20260806 15:10:18.517393 12730 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:18.517467 12730 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:18.518847 12730 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:18.519527 12745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.519695 12730 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:18.519801 12730 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "70d00687b4574084b4ebd73b72c07f03"
format_stamp: "Formatted at 2026-08-06 15:10:16 on dist-test-slave-tm1g"
server_key: "7f2150a4390773f7af763f09b00d7b7c"
server_key_iv: "8172415c0617a0bd748822cb168feca2"
server_key_version: "encryptionkey@0"
I20260806 15:10:18.520129 12730 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:18.527325 12730 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:18.529503 12730 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:18.529659 12730 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:18.533836 12730 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:40503
I20260806 15:10:18.533867 12797 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:40503 every 8 connection(s)
I20260806 15:10:18.534224 12730 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:18.535733 12798 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:10:18.536312 12798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap starting.
I20260806 15:10:18.537823 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12730
I20260806 15:10:18.538184 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:44137
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:40503
--webserver_port=38741
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:18.545708 12798 log.cc:824] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:18.547906 12798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:18.548229 12798 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03: Bootstrap complete.
I20260806 15:10:18.550537 12798 raft_consensus.cc:348] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:18.550755 12798 raft_consensus.cc:729] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70d00687b4574084b4ebd73b72c07f03, State: Initialized, Role: FOLLOWER
I20260806 15:10:18.550920 12798 consensus_queue.cc:260] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:18.550987 12798 raft_consensus.cc:388] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:18.551049 12798 raft_consensus.cc:482] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:18.551097 12798 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 2 FOLLOWER]: Advancing to term 3
I20260806 15:10:18.552167 12798 raft_consensus.cc:504] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:18.552255 12798 leader_election.cc:302] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 70d00687b4574084b4ebd73b72c07f03; no voters:
I20260806 15:10:18.552471 12798 leader_election.cc:288] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 15:10:18.552512 12802 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 15:10:18.552628 12802 raft_consensus.cc:686] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [term 3 LEADER]: Becoming Leader. State: Replica: 70d00687b4574084b4ebd73b72c07f03, State: Running, Role: LEADER
I20260806 15:10:18.552744 12798 sys_catalog.cc:564] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:18.552721 12802 consensus_queue.cc:237] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } }
I20260806 15:10:18.553011 12802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 70d00687b4574084b4ebd73b72c07f03. Latest consensus state: current_term: 3 leader_uuid: "70d00687b4574084b4ebd73b72c07f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } } }
I20260806 15:10:18.553092 12802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:18.553015 12803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "70d00687b4574084b4ebd73b72c07f03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "70d00687b4574084b4ebd73b72c07f03" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40503 } } }
I20260806 15:10:18.553257 12803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 70d00687b4574084b4ebd73b72c07f03 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:18.553313 12806 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:18.554164 12806 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:18.554289 12806 catalog_manager.cc:1259] Loaded cluster ID: bb67029c486c4eafa4398bc10e7ed262
I20260806 15:10:18.554355 12806 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260806 15:10:18.554811 12806 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5da89cc9ad google::LogMessage::Fail() at ??:0
@ 0x7f5da89cf88a google::LogMessage::SendToLog() at ??:0
@ 0x7f5da89cc4de google::LogMessage::Flush() at ??:0
@ 0x7f5da89cda19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5db08ed0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5db08f68b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5daa89a0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5daa88f954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5dab6f36db start_thread at ??:0
@ 0x7f5da74ca61f clone at ??:0
W20260806 15:10:18.654904 12800 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:18.655179 12800 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:18.655216 12800 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:18.656879 12800 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:18.656936 12800 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:18.656975 12800 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:18.658943 12800 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:44137
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=38741
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12800
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:18.659149 12800 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:18.659410 12800 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:18.664425 12834 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.664425 12835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.664680 12837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.664740 12800 server_base.cc:1034] running on GCE node
I20260806 15:10:18.664968 12800 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:18.665187 12800 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:18.666368 12800 hybrid_clock.cc:648] HybridClock initialized: now 1786029018666351 us; error 29 us; skew 500 ppm
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:18.669343 12800 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:18.669860 12800 webserver.cc:460] Webserver started at http://127.29.69.129:38741/ using document root <none> and password file <none>
I20260806 15:10:18.670111 12800 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:18.670182 12800 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:18.671703 12800 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:18.672441 12844 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.672634 12800 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:18.672726 12800 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "c64984ba4378ebd1677ffbfc4b5ba8b1"
server_key_iv: "e96403ccb7d52c80d62d4c809ea61778"
server_key_version: "encryptionkey@0"
I20260806 15:10:18.673154 12800 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:18.699595 12800 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:18.702214 12800 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:18.702399 12800 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:18.702673 12800 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:18.703228 12851 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:10:18.704843 12800 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:10:18.704905 12800 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 15:10:18.704941 12800 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:10:18.705849 12800 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:10:18.705895 12800 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260806 15:10:18.705994 12851 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap starting.
I20260806 15:10:18.713307 12800 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:44137
I20260806 15:10:18.713770 12800 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:10:18.714118 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12800
I20260806 15:10:18.714408 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:42689
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:40503
--webserver_port=37251
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:18.717518 12851 log.cc:824] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:18.718879 12961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:44137 every 8 connection(s)
I20260806 15:10:18.719978 12851 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:18.720280 12851 tablet_bootstrap.cc:492] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Bootstrap complete.
I20260806 15:10:18.721253 12851 ts_tablet_manager.cc:1397] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent bootstrapping tablet: real 0.015s user 0.013s sys 0.000s
I20260806 15:10:18.722275 12851 raft_consensus.cc:348] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.722607 12851 raft_consensus.cc:729] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 219fbec6a9eb4e64a3bdec7e1a4085d3, State: Initialized, Role: FOLLOWER
I20260806 15:10:18.722775 12851 consensus_queue.cc:260] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:18.723096 12851 ts_tablet_manager.cc:1428] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s
W20260806 15:10:18.805974 12963 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:10:18.714613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:42019)
0806 15:10:18.717386 (+ 2773us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.717438 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:18.718183 (+ 745us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:18.805724 (+ 87541us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":2711,"thread_start_us":119,"threads_started":1}
W20260806 15:10:18.806274 12962 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:40503 (0 consecutive failures): Network error: Failed to ping master at 127.29.69.190:40503: Client connection negotiation failed: client connection to 127.29.69.190:40503: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:10:18.806711 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.806559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:47519)
0806 15:10:18.806620 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.806677 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 15:10:18.807101 12963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.806996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:60665)
0806 15:10:18.807046 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.807077 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 15:10:18.807253 12962 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:10:18.824679 12964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:18.824885 12964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:18.824909 12964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:18.826121 12964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:18.826164 12964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:18.826190 12964 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:10:18.827736 12964 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:42689
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=37251
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:18.827977 12964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:18.828208 12964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:10:18.833158 12964 server_base.cc:1034] running on GCE node
W20260806 15:10:18.833103 12975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.833106 12972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.833112 12973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.833518 12964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:18.833760 12964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:18.834923 12964 hybrid_clock.cc:648] HybridClock initialized: now 1786029018834909 us; error 42 us; skew 500 ppm
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:18.837306 12964 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:18.837775 12964 webserver.cc:460] Webserver started at http://127.29.69.130:37251/ using document root <none> and password file <none>
I20260806 15:10:18.838003 12964 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:18.838075 12964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:18.839550 12964 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:18.840163 12982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.840350 12964 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:18.840456 12964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "643e0991fce7441f8755dde948bed15b"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "22538ee96237ec3dd4b68d756039eb9d"
server_key_iv: "447481b8f85f290cbeb64b1c5799f542"
server_key_version: "encryptionkey@0"
I20260806 15:10:18.840791 12964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:18.855914 12964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:18.857668 12964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:18.857826 12964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:18.858044 12964 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:18.858423 12964 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:18.858484 12964 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.858534 12964 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:18.858563 12964 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.864575 12964 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:42689
I20260806 15:10:18.864621 13096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:42689 every 8 connection(s)
I20260806 15:10:18.864943 12964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:10:18.865914 13099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.865496 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:47191)
0806 15:10:18.865654 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.865770 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":80,"threads_started":1}
W20260806 15:10:18.866371 13097 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:40503 (0 consecutive failures): Network error: Failed to ping master at 127.29.69.190:40503: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
I20260806 15:10:18.866667 13099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.866578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:43375)
0806 15:10:18.866622 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.866649 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 15:10:18.866909 13099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.866860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:51531)
0806 15:10:18.866879 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.866897 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":12}
W20260806 15:10:18.867012 13097 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 15:10:18.870878 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 12964
I20260806 15:10:18.871152 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:39571
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:40503
--webserver_port=34345
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:18.952683 13100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:18.952919 13100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:18.952956 13100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:18.954074 13100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:18.954144 13100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:18.954187 13100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:18.955665 13100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:39571
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=34345
--tserver_master_addrs=127.29.69.190:40503
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:18.955930 13100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:18.956168 13100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:18.961268 13105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.961247 13108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:18.961305 13106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:18.961545 13100 server_base.cc:1034] running on GCE node
I20260806 15:10:18.961752 13100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:18.961946 13100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:18.963136 13100 hybrid_clock.cc:648] HybridClock initialized: now 1786029018963123 us; error 30 us; skew 500 ppm
Aug 06 15:10:18 dist-test-slave-tm1g krb5kdc[11643](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:18.965577 13100 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:18.966066 13100 webserver.cc:460] Webserver started at http://127.29.69.131:34345/ using document root <none> and password file <none>
I20260806 15:10:18.966356 13100 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:18.966420 13100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:18.967711 13100 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:18.968369 13115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.968569 13100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:18.968681 13100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "dddd1c6553c046b6a6e16a80ec029252"
format_stamp: "Formatted at 2026-08-06 15:10:17 on dist-test-slave-tm1g"
server_key: "3117901924369abc1b4dde09d7537462"
server_key_iv: "271dc3307c018f193e3e744abc648c5e"
server_key_version: "encryptionkey@0"
I20260806 15:10:18.969049 13100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:18.984771 13100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:18.986644 13100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:18.986802 13100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:18.987031 13100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:18.987334 13100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:18.987388 13100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.987423 13100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:18.987452 13100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:18.993274 13100 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:39571
I20260806 15:10:18.993352 13229 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:39571 every 8 connection(s)
I20260806 15:10:18.993695 13100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:10:18.994753 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.994384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:57631)
0806 15:10:18.994543 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.994618 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
W20260806 15:10:18.995187 13230 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:40503 (0 consecutive failures): Network error: Failed to ping master at 127.29.69.190:40503: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
I20260806 15:10:18.995474 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.995363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:42605)
0806 15:10:18.995428 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.995455 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260806 15:10:18.995728 13232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:18.995664 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:41871)
0806 15:10:18.995696 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:18.995715 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260806 15:10:18.995844 13230 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 15:10:18.996366 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13100
I20260806 15:10:19.807912 13234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:19.807642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:37453)
0806 15:10:19.807797 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:19.807842 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":71,"threads_started":1}
I20260806 15:10:19.867578 13235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:19.867364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:58075)
0806 15:10:19.867495 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:19.867528 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":59,"threads_started":1}
I20260806 15:10:19.996402 13236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:19.996204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:59821)
0806 15:10:19.996325 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:19.996358 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":59,"threads_started":1}
I20260806 15:10:20.145661 13237 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:20.145817 13237 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:20.146235 13237 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571), 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
Aug 06 15:10:20 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.131@KRBTEST.COM
Aug 06 15:10:20 dist-test-slave-tm1g krb5kdc[11643](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029018, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.130@KRBTEST.COM
I20260806 15:10:20.157023 13240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.146600 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:35213 (local address 127.29.69.131:39571)
0806 15:10:20.146729 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:20.146742 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:20.146782 (+ 40us) server_negotiation.cc:407] Connection header received
0806 15:10:20.147218 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:20.147220 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:20.147259 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:20.147409 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:20.148066 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.149068 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.150601 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.151007 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.151101 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:20.153426 (+ 2325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:20.153430 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:20.153430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:20.153447 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:20.155312 (+ 1865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:20.155807 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:20.155810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:20.155811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:20.155902 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:20.156169 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:20.156170 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:20.156171 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:20.156402 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:20.156491 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:20.156778 (+ 287us) server_negotiation.cc:299] Negotiation successful
0806 15:10:20.156899 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":51,"threads_started":1}
I20260806 15:10:20.157011 13234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.146407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:39571 (local address 127.29.69.129:35213)
0806 15:10:20.146475 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:20.146486 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:20.146545 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:20.147452 (+ 907us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:20.147455 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:20.147769 (+ 314us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:20.147946 (+ 177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:20.147952 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.149189 (+ 1237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.149190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:20.150498 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:20.150501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.151091 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.151092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:20.151187 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:20.151735 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:20.151744 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:20.153302 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:20.155417 (+ 2115us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:20.155430 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:20.155432 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:20.155710 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:20.155986 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:20.155987 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:20.155987 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:20.156103 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:20.156482 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:20.156489 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:20.156617 (+ 128us) client_negotiation.cc:769] Sending connection context
0806 15:10:20.156721 (+ 104us) client_negotiation.cc:240] Negotiation successful
0806 15:10:20.156912 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":49,"mutex_wait_us":81}
I20260806 15:10:20.157045 13239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.146522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:49923 (local address 127.29.69.130:42689)
0806 15:10:20.146740 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:20.146748 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:20.146775 (+ 27us) server_negotiation.cc:407] Connection header received
0806 15:10:20.147216 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:20.147219 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:20.147259 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:20.147374 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:20.148362 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.149211 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.151172 (+ 1961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.151547 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.151662 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:20.153780 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:20.153783 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:20.153784 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:20.153794 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:20.155362 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:20.155807 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:20.155810 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:20.155811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:20.155898 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:20.156177 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:20.156178 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:20.156178 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:20.156401 (+ 223us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:20.156497 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:20.156790 (+ 293us) server_negotiation.cc:299] Negotiation successful
0806 15:10:20.156928 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":187,"thread_start_us":55,"threads_started":1}
I20260806 15:10:20.157132 13238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.146453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:42689 (local address 127.29.69.129:49923)
0806 15:10:20.146622 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:20.146631 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:20.146668 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:20.148067 (+ 1399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:20.148068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:20.148238 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:20.148276 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:20.148277 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.149300 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.149301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:20.150498 (+ 1197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:20.150501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:20.151635 (+ 1134us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:20.151636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:20.151696 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:20.152115 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:20.152119 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:20.153676 (+ 1557us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:20.155475 (+ 1799us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:20.155476 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:20.155476 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:20.155714 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:20.155970 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:20.155971 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:20.155971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:20.156102 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:20.156479 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:20.156486 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:20.156618 (+ 132us) client_negotiation.cc:769] Sending connection context
0806 15:10:20.156723 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 15:10:20.156996 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":161,"thread_start_us":69,"threads_started":1}
W20260806 15:10:20.157861 12846 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
W20260806 15:10:20.157989 12845 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:20.158049 12845 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3; no voters: 643e0991fce7441f8755dde948bed15b, dddd1c6553c046b6a6e16a80ec029252
I20260806 15:10:20.158139 13237 raft_consensus.cc:2726] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:10:20.808698 13241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.808467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:54701)
0806 15:10:20.808609 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:20.808645 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":66,"threads_started":1}
I20260806 15:10:20.868435 13242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.868195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:56199)
0806 15:10:20.868345 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:20.868394 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":66,"threads_started":1}
I20260806 15:10:20.997169 13243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:20.996936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:41127)
0806 15:10:20.997080 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:20.997128 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":63,"threads_started":1}
I20260806 15:10:21.809406 13244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:21.809189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:51373)
0806 15:10:21.809312 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:21.809352 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":66,"threads_started":1}
I20260806 15:10:21.869135 13245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:21.868914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:40503)
0806 15:10:21.869058 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:21.869095 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":72,"threads_started":1}
I20260806 15:10:21.997860 13246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:21.997621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:59383)
0806 15:10:21.997781 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:21.997819 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":78,"threads_started":1}
I20260806 15:10:22.064379 13247 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:22.064477 13247 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:22.064689 13247 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571), 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
W20260806 15:10:22.065100 12846 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
W20260806 15:10:22.065181 12845 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:22.065296 12845 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3; no voters: 643e0991fce7441f8755dde948bed15b, dddd1c6553c046b6a6e16a80ec029252
I20260806 15:10:22.065404 13247 raft_consensus.cc:2726] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:10:22.810132 13248 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:22.809894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:56695)
0806 15:10:22.810040 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:22.810080 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":64,"threads_started":1}
I20260806 15:10:22.869798 13249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:22.869607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:60823)
0806 15:10:22.869726 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:22.869758 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":62,"threads_started":1}
I20260806 15:10:22.998540 13250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:22.998321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:35019)
0806 15:10:22.998463 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:22.998500 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":81,"threads_started":1}
I20260806 15:10:23.810920 13251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:23.810688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:58749)
0806 15:10:23.810836 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:23.810871 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":82,"threads_started":1}
I20260806 15:10:23.839013 13252 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:23.839108 13252 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:23.839320 13252 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571), 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
W20260806 15:10:23.839743 12845 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
W20260806 15:10:23.839829 12846 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:23.839956 12846 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3; no voters: 643e0991fce7441f8755dde948bed15b, dddd1c6553c046b6a6e16a80ec029252
I20260806 15:10:23.840073 13252 raft_consensus.cc:2726] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:10:23.870589 13253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:23.870385 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:55731)
0806 15:10:23.870503 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:23.870547 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":58,"threads_started":1}
I20260806 15:10:23.999223 13254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:23.999017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:38443)
0806 15:10:23.999155 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:23.999187 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260806 15:10:24.811614 13255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:24.811366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:52899)
0806 15:10:24.811528 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:24.811565 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
I20260806 15:10:24.871322 13256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:24.871102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:48423)
0806 15:10:24.871236 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:24.871280 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260806 15:10:24.999918 13257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:24.999706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:53071)
0806 15:10:24.999840 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:24.999876 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":62,"threads_started":1}
I20260806 15:10:25.812306 13258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:25.812094 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:52827)
0806 15:10:25.812227 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:25.812257 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":79,"threads_started":1}
I20260806 15:10:25.871925 13259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:25.871733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:54601)
0806 15:10:25.871844 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:25.871886 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260806 15:10:26.000617 13260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:26.000378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:53911)
0806 15:10:26.000533 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:26.000572 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":64,"threads_started":1}
I20260806 15:10:26.813109 13261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:26.812868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:41215)
0806 15:10:26.813012 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:26.813059 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":84,"threads_started":1}
I20260806 15:10:26.872562 13262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:26.872348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:33129)
0806 15:10:26.872481 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:26.872519 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":61,"threads_started":1}
I20260806 15:10:27.001374 13263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:27.001083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:36781)
0806 15:10:27.001241 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:27.001311 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":105,"threads_started":1}
I20260806 15:10:27.278602 13264 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:27.278702 13264 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:27.278937 13264 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571), 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
W20260806 15:10:27.279253 12845 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
W20260806 15:10:27.279336 12846 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:27.279407 12846 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3; no voters: 643e0991fce7441f8755dde948bed15b, dddd1c6553c046b6a6e16a80ec029252
I20260806 15:10:27.279495 13264 raft_consensus.cc:2726] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:10:27.813930 13265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:27.813629 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:40321)
0806 15:10:27.813817 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:27.813854 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":76,"threads_started":1}
I20260806 15:10:27.873250 13266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:27.873040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:57527)
0806 15:10:27.873168 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:27.873206 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":77,"threads_started":1}
I20260806 15:10:28.002036 13267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:28.001843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:60691)
0806 15:10:28.001954 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:28.001990 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":59,"threads_started":1}
I20260806 15:10:28.815245 13268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:28.814871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:40415)
0806 15:10:28.815090 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:28.815148 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":108,"threads_started":1}
I20260806 15:10:28.873942 13269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:28.873720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:60133)
0806 15:10:28.873861 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:28.873898 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260806 15:10:29.002704 13270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:29.002518 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:39979)
0806 15:10:29.002625 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:29.002660 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":58,"threads_started":1}
I20260806 15:10:29.816156 13271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:29.815892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:35045)
0806 15:10:29.816060 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:29.816101 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":67,"threads_started":1}
I20260806 15:10:29.874629 13272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:29.874406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:60695)
0806 15:10:29.874552 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:29.874587 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260806 15:10:30.003326 13273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:30.003104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:52541)
0806 15:10:30.003250 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:30.003282 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260806 15:10:30.816825 13274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:30.816613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:40989)
0806 15:10:30.816737 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:30.816773 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260806 15:10:30.875360 13275 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:30.875124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:37913)
0806 15:10:30.875275 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:30.875314 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":81,"threads_started":1}
I20260806 15:10:31.003976 13276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:31.003735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:42867)
0806 15:10:31.003889 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:31.003927 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":63,"threads_started":1}
I20260806 15:10:31.817516 13277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:31.817302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:56761)
0806 15:10:31.817429 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:31.817466 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":68,"threads_started":1}
I20260806 15:10:31.876040 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:31.875815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:51755)
0806 15:10:31.875958 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:31.875996 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260806 15:10:32.004737 13279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:32.004479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:44195)
0806 15:10:32.004637 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:32.004677 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":82,"threads_started":1}
I20260806 15:10:32.818379 13280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:32.818019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:56547)
0806 15:10:32.818225 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:32.818266 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
I20260806 15:10:32.876885 13281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:32.876657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:60485)
0806 15:10:32.876788 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:32.876829 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":103,"threads_started":1}
I20260806 15:10:33.005511 13282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:33.005250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:37215)
0806 15:10:33.005426 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:33.005462 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":91,"threads_started":1}
I20260806 15:10:33.438493 13283 raft_consensus.cc:482] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:33.438597 13283 raft_consensus.cc:504] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "dddd1c6553c046b6a6e16a80ec029252" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 39571 } } peers { permanent_uuid: "643e0991fce7441f8755dde948bed15b" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 42689 } } peers { permanent_uuid: "219fbec6a9eb4e64a3bdec7e1a4085d3" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44137 } }
I20260806 15:10:33.438798 13283 leader_election.cc:288] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571), 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689)
W20260806 15:10:33.439208 12845 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer dddd1c6553c046b6a6e16a80ec029252 (127.29.69.131:39571): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
W20260806 15:10:33.439303 12846 leader_election.cc:341] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 643e0991fce7441f8755dde948bed15b (127.29.69.130:42689): Not found: Tablet not found: 19a0b24f9d4e44149b290fcc617ec5f2
I20260806 15:10:33.439375 12846 leader_election.cc:302] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 219fbec6a9eb4e64a3bdec7e1a4085d3; no voters: 643e0991fce7441f8755dde948bed15b, dddd1c6553c046b6a6e16a80ec029252
I20260806 15:10:33.439442 13283 raft_consensus.cc:2726] T 19a0b24f9d4e44149b290fcc617ec5f2 P 219fbec6a9eb4e64a3bdec7e1a4085d3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:10:33.819245 13284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:33.819006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.129:44655)
0806 15:10:33.819167 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:33.819197 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
I20260806 15:10:33.877707 13285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:33.877420 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.130:58871)
0806 15:10:33.877620 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:33.877656 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":80,"threads_started":1}
I20260806 15:10:34.006481 13286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:34.006169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40503 (local address 127.29.69.131:45015)
0806 15:10:34.006394 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:34.006434 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:40503: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":70,"threads_started":1}
I20260806 15:10:34.006621 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12800
I20260806 15:10:34.012670 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 12964
I20260806 15:10:34.017565 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13100
2026-08-06T15:10:34Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18421 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:10:34 dist-test-slave-tm1g krb5kdc[13289](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:10:34 dist-test-slave-tm1g krb5kdc[13289](info): set up 2 sockets
Aug 06 15:10:34 dist-test-slave-tm1g krb5kdc[13289](info): commencing operation
krb5kdc: starting...
W20260806 15:10:35.062704 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:10:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:10:35Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:10:35.181506 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35559
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:35559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:35.265503 13302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:35.265730 13302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:35.265770 13302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:35.266980 13302 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 15:10:35.267047 13302 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 15:10:35.267068 13302 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 15:10:35.267087 13302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:35.267114 13302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:35.267146 13302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:35.267171 13302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:35.267200 13302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:35.268914 13302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:35559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13302
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:35.269225 13302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:35.269459 13302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:10:35.274194 13302 server_base.cc:1034] running on GCE node
W20260806 15:10:35.274171 13308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:35.274176 13311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:35.274187 13307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:35.274669 13302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:35.274958 13302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:35.276095 13302 hybrid_clock.cc:648] HybridClock initialized: now 1786029035276082 us; error 30 us; skew 500 ppm
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:35.278520 13302 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:35.278980 13302 webserver.cc:460] Webserver started at http://127.29.69.190:41353/ using document root <none> and password file <none>
I20260806 15:10:35.279206 13302 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:35.279273 13302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:35.279423 13302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:35.280429 13302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "931e059c1a144df0a796dfaaea4d4954"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "56258f84997eee9d57d71713fcd6d69b"
server_key_iv: "554193b1eff584201a05d22bf34ece0f"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.280797 13302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "931e059c1a144df0a796dfaaea4d4954"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "56258f84997eee9d57d71713fcd6d69b"
server_key_iv: "554193b1eff584201a05d22bf34ece0f"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.282099 13302 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:10:35.282898 13318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.283080 13302 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.283183 13302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "931e059c1a144df0a796dfaaea4d4954"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "56258f84997eee9d57d71713fcd6d69b"
server_key_iv: "554193b1eff584201a05d22bf34ece0f"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.283267 13302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:35.296665 13302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:35.298472 13302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:35.298627 13302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:35.302775 13302 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:35559
I20260806 15:10:35.302814 13370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:35559 every 8 connection(s)
I20260806 15:10:35.303167 13302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:35.304015 13371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:35.306126 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13302
I20260806 15:10:35.306239 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:10:35.306468 29974 external_mini_cluster.cc:1428] Setting key 7c0fa5aeb354c4b77dfd3d39d6fcfcb1
I20260806 15:10:35.306648 13371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap starting.
I20260806 15:10:35.307410 13371 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:35.307732 13371 log.cc:824] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:35.308548 13371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: No bootstrap required, opened a new log
I20260806 15:10:35.310640 13371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:35.310820 13371 raft_consensus.cc:374] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:35.310863 13371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931e059c1a144df0a796dfaaea4d4954, State: Initialized, Role: FOLLOWER
I20260806 15:10:35.311028 13371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:35.311096 13371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:35.311141 13371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:35.311187 13371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:35.311755 13371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:35.311866 13371 leader_election.cc:302] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 931e059c1a144df0a796dfaaea4d4954; no voters:
I20260806 15:10:35.312038 13371 leader_election.cc:288] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:10:35.312099 13376 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:35.312256 13376 raft_consensus.cc:686] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 LEADER]: Becoming Leader. State: Replica: 931e059c1a144df0a796dfaaea4d4954, State: Running, Role: LEADER
I20260806 15:10:35.312390 13371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:35.312402 13376 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:35.312990 13377 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "931e059c1a144df0a796dfaaea4d4954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } } }
I20260806 15:10:35.313093 13377 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:35.313342 13378 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931e059c1a144df0a796dfaaea4d4954. Latest consensus state: current_term: 1 leader_uuid: "931e059c1a144df0a796dfaaea4d4954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } } }
I20260806 15:10:35.313460 13378 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:35.313627 13384 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:35.314211 13384 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:35.316689 13384 catalog_manager.cc:1347] Generated new cluster ID: 44002fa210574bd080d3038ad2ccc62e
I20260806 15:10:35.316744 13384 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:35.318538 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.307001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57892 (local address 127.29.69.190:35559)
0806 15:10:35.307170 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.307179 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.307215 (+ 36us) server_negotiation.cc:407] Connection header received
0806 15:10:35.307686 (+ 471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.307692 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.307739 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.307888 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:35.308753 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.309639 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.310848 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.311437 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.311623 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.314771 (+ 3148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:35.314775 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:35.314776 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:35.314786 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:35.316845 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.317262 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.317265 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.317265 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.317367 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.317595 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.317596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.317596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.317875 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:35.318008 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.318160 (+ 152us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.318292 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260806 15:10:35.334092 13384 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:10:35.334719 13384 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:35.351485 13384 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Generated new TSK 0
I20260806 15:10:35.351693 13384 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:10:35.386582 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35559
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:35.490198 13397 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:35.490430 13397 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:35.490463 13397 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:35.491549 13397 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:35.491621 13397 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:35.491669 13397 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:35.493083 13397 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13397
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:35.493268 13397 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:35.493441 13397 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:35.498493 13406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:35.498553 13397 server_base.cc:1034] running on GCE node
W20260806 15:10:35.498636 13404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:35.498544 13403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:35.498965 13397 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:35.499231 13397 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:35.500409 13397 hybrid_clock.cc:648] HybridClock initialized: now 1786029035500394 us; error 42 us; skew 500 ppm
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:35.503026 13397 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:35.503520 13397 webserver.cc:460] Webserver started at http://127.29.69.129:35189/ using document root <none> and password file <none>
I20260806 15:10:35.503750 13397 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:35.503821 13397 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:35.503978 13397 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:35.505115 13397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "53f81a800fdb7e618bb184007b97c985"
server_key_iv: "4d14ec62e601c86ae239e7a359a05dca"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.505506 13397 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "53f81a800fdb7e618bb184007b97c985"
server_key_iv: "4d14ec62e601c86ae239e7a359a05dca"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.506898 13397 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:10:35.507620 13413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.507791 13397 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:35.507890 13397 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "53f81a800fdb7e618bb184007b97c985"
server_key_iv: "4d14ec62e601c86ae239e7a359a05dca"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.507965 13397 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:35.520110 13397 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:35.521844 13397 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:35.522027 13397 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:35.522272 13397 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:35.522617 13397 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:35.522670 13397 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.522711 13397 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:35.522739 13397 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.528774 13397 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:43787
I20260806 15:10:35.528829 13527 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:43787 every 8 connection(s)
I20260806 15:10:35.529129 13397 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:10:35.532312 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13397
I20260806 15:10:35.532406 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:10:35.532655 29974 external_mini_cluster.cc:1428] Setting key 79d230aa25f1544ba19bae2a51bde3af
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:35.539395 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.529867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:36919 (local address 127.29.69.190:35559)
0806 15:10:35.529958 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.529961 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.530137 (+ 176us) server_negotiation.cc:407] Connection header received
0806 15:10:35.530688 (+ 551us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.530690 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.530702 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.530750 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:35.531698 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.532229 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.533559 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.533786 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.533859 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.536518 (+ 2659us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:35.536519 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:35.536519 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:35.536526 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:35.537888 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.538415 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.538416 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.538416 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.538466 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.538762 (+ 296us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.538763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.538763 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.538866 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:35.538913 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.539262 (+ 349us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.539331 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260806 15:10:35.539669 13530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.529813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:36919)
0806 15:10:35.530000 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:35.530048 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:35.530577 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:35.530826 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:35.530830 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:35.531388 (+ 558us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:35.531580 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.531584 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.532326 (+ 742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.532327 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.533462 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.533465 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.533869 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.533870 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.534006 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.534597 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:35.534608 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:35.536421 (+ 1813us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:35.537968 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:35.537976 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:35.537978 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:35.538337 (+ 359us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:35.538532 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:35.538533 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:35.538534 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:35.538686 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:35.538929 (+ 243us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:35.538936 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:35.539116 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 15:10:35.539237 (+ 121us) client_negotiation.cc:240] Negotiation successful
0806 15:10:35.539418 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":89,"threads_started":1}
I20260806 15:10:35.540216 13528 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35559
I20260806 15:10:35.540309 13528 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:35.540496 13528 heartbeater.cc:511] Master 127.29.69.190:35559 requested a full tablet report, sending...
I20260806 15:10:35.540980 13335 ts_manager.cc:194] Registered new tserver with Master: fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129:43787)
I20260806 15:10:35.541595 13335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:36919
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:10:35.559103 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35559
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:35.639079 13533 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:35.639276 13533 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:35.639298 13533 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:35.640493 13533 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:35.640537 13533 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:35.640564 13533 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:10:35.641945 13533 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13533
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:35.642132 13533 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:35.642295 13533 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:35.647073 13538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:35.647132 13539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:35.647084 13541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:35.647292 13533 server_base.cc:1034] running on GCE node
I20260806 15:10:35.647492 13533 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:35.647691 13533 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:35.648866 13533 hybrid_clock.cc:648] HybridClock initialized: now 1786029035648853 us; error 46 us; skew 500 ppm
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:35.651229 13533 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:35.651646 13533 webserver.cc:460] Webserver started at http://127.29.69.130:36623/ using document root <none> and password file <none>
I20260806 15:10:35.651872 13533 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:35.651938 13533 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:35.652083 13533 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:35.653290 13533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "03879ab9b54549b69f37b0455d7396b2"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "bb92e33f6947c58db4641e7f990f2d83"
server_key_iv: "95c6b8fca6df07b46fbd5f0adbcf04e5"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.653709 13533 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "03879ab9b54549b69f37b0455d7396b2"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "bb92e33f6947c58db4641e7f990f2d83"
server_key_iv: "95c6b8fca6df07b46fbd5f0adbcf04e5"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.655644 13533 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260806 15:10:35.656773 13548 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.656948 13533 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:35.657054 13533 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "03879ab9b54549b69f37b0455d7396b2"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "bb92e33f6947c58db4641e7f990f2d83"
server_key_iv: "95c6b8fca6df07b46fbd5f0adbcf04e5"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.657130 13533 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:35.678464 13533 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:35.680444 13533 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:35.680619 13533 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:35.680850 13533 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:35.681176 13533 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:35.681236 13533 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.681277 13533 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:35.681304 13533 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.687458 13533 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:37643
I20260806 15:10:35.687561 13663 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:37643 every 8 connection(s)
I20260806 15:10:35.687866 13533 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:35.693969 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13533
I20260806 15:10:35.694075 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:10:35.694264 29974 external_mini_cluster.cc:1428] Setting key 91b8c915436defa79e4e3455b32507a9
I20260806 15:10:35.697405 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.688651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:45453 (local address 127.29.69.190:35559)
0806 15:10:35.688717 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.688720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.688924 (+ 204us) server_negotiation.cc:407] Connection header received
0806 15:10:35.689403 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.689404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.689415 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.689483 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:35.690449 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.690965 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.691956 (+ 991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.692160 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.692224 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.694459 (+ 2235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:35.694460 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:35.694461 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:35.694469 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:35.695990 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.696416 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.696417 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.696417 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.696475 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.696741 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.696742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.696743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.696864 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:35.696941 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.697218 (+ 277us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.697298 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:10:35.697577 13666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.688621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:45453)
0806 15:10:35.688778 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:35.688819 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:35.689301 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:35.689536 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:35.689539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:35.690104 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:35.690350 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.690357 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.691067 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.691068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.691860 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.691862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.692242 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.692242 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.692342 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.692823 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:35.692830 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:35.694372 (+ 1542us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:35.696095 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:35.696103 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:35.696105 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:35.696339 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:35.696556 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:35.696557 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:35.696557 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:35.696668 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:35.696932 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:35.696939 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:35.697080 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 15:10:35.697182 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 15:10:35.697343 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260806 15:10:35.698050 13664 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35559
I20260806 15:10:35.698151 13664 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:35.698381 13664 heartbeater.cc:511] Master 127.29.69.190:35559 requested a full tablet report, sending...
I20260806 15:10:35.698742 13335 ts_manager.cc:194] Registered new tserver with Master: 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
I20260806 15:10:35.699134 13335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:45453
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:10:35.719242 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35559
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:35.801426 13669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:35.801652 13669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:35.801690 13669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:35.802922 13669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:35.802990 13669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:35.803036 13669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:35.804774 13669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13669
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:35.805027 13669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:35.805266 13669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:35.810263 13675 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:35.810274 13674 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:35.810444 13669 server_base.cc:1034] running on GCE node
W20260806 15:10:35.810281 13677 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:35.810773 13669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:35.811048 13669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:35.812202 13669 hybrid_clock.cc:648] HybridClock initialized: now 1786029035812198 us; error 44 us; skew 500 ppm
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:35.814867 13669 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:35.815302 13669 webserver.cc:460] Webserver started at http://127.29.69.131:43419/ using document root <none> and password file <none>
I20260806 15:10:35.815537 13669 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:35.815583 13669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:35.815752 13669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:10:35.816798 13669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "82183b4d301349f9af430a04af7a6011"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "8e938113adc60e833121bf3472e24852"
server_key_iv: "a7f64d9450fac6451fa6bdad67dc6a45"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.817169 13669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "82183b4d301349f9af430a04af7a6011"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "8e938113adc60e833121bf3472e24852"
server_key_iv: "a7f64d9450fac6451fa6bdad67dc6a45"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.818663 13669 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:10:35.819415 13684 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.819589 13669 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:10:35.819690 13669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "82183b4d301349f9af430a04af7a6011"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "8e938113adc60e833121bf3472e24852"
server_key_iv: "a7f64d9450fac6451fa6bdad67dc6a45"
server_key_version: "encryptionkey@0"
I20260806 15:10:35.819777 13669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:35.852764 13669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:35.854728 13669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:35.854892 13669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:35.855122 13669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:35.855440 13669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:35.855495 13669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.855538 13669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:35.855566 13669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:35.861474 13669 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36655
I20260806 15:10:35.861518 13799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36655 every 8 connection(s)
I20260806 15:10:35.861822 13669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:10:35.864007 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13669
I20260806 15:10:35.864091 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:10:35.864275 29974 external_mini_cluster.cc:1428] Setting key a4b9ab3987ec24a91b0b951e58c86278
Aug 06 15:10:35 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029035, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:35.871290 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.862565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:54529 (local address 127.29.69.190:35559)
0806 15:10:35.862632 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.862635 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.862842 (+ 207us) server_negotiation.cc:407] Connection header received
0806 15:10:35.863347 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.863348 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.863358 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.863418 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:35.864407 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.865132 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.866149 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.866428 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.866503 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.868568 (+ 2065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:35.868569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:35.868570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:35.868578 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:35.869848 (+ 1270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.870291 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.870292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.870292 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.870382 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.870637 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.870638 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.870638 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.870760 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:35.870836 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.871119 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.871198 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 15:10:35.871490 13803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.862545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:54529)
0806 15:10:35.862726 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:35.862762 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:35.863239 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:35.863491 (+ 252us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:35.863494 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:35.864044 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:35.864321 (+ 277us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.864327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.865216 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.865218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.866054 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.866056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.866511 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.866512 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.866642 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.867071 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:35.867078 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:35.868466 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:35.869972 (+ 1506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:35.869979 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:35.869982 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:35.870208 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:35.870451 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:35.870452 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:35.870452 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:35.870566 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:35.870828 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:35.870835 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:35.870979 (+ 144us) client_negotiation.cc:769] Sending connection context
0806 15:10:35.871084 (+ 105us) client_negotiation.cc:240] Negotiation successful
0806 15:10:35.871244 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":103,"threads_started":1}
I20260806 15:10:35.871987 13800 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35559
I20260806 15:10:35.872089 13800 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:35.872273 13800 heartbeater.cc:511] Master 127.29.69.190:35559 requested a full tablet report, sending...
I20260806 15:10:35.872682 13335 ts_manager.cc:194] Registered new tserver with Master: 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655)
I20260806 15:10:35.873060 13335 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:54529
I20260806 15:10:35.876062 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:10:35.883082 13374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.877396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57898 (local address 127.29.69.190:35559)
0806 15:10:35.877475 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.877477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.877501 (+ 24us) server_negotiation.cc:407] Connection header received
0806 15:10:35.877571 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.877572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.877580 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.877624 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:35.878145 (+ 521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.878670 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.879352 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.879526 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.879581 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.880700 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:35.880701 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:35.880701 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:35.880707 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:35.882018 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.882381 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.882382 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.882383 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.882430 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:35.882597 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:35.882597 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:35.882598 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:35.882729 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:35.882804 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.882944 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.883001 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260806 15:10:35.884503 13335 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:10:35.886183 13335 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:10:35.892962 13816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.888738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43610 (local address 127.29.69.130:37643)
0806 15:10:35.888937 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.888942 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.888954 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:10:35.888994 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.888997 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.889014 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.889116 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:35.889320 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.890499 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.891864 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.892516 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.892597 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.892656 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.892826 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.892877 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":82,"threads_started":1}
I20260806 15:10:35.892951 13813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.888716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:43787 (local address 127.0.0.1:57242)
0806 15:10:35.889143 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:35.889153 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:35.889203 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:35.889457 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:35.889458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:35.889460 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:35.889512 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.889513 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.890771 (+ 1258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.890772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.891703 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.891705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.892608 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.892609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.892696 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.892713 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 15:10:35.892788 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 15:10:35.892851 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":406,"mutex_wait_us":5,"thread_start_us":78,"threads_started":1}
I20260806 15:10:35.892951 13815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.888533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:37643 (local address 127.0.0.1:43610)
0806 15:10:35.888833 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:35.888850 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:35.888891 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:35.889129 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:35.889133 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:35.889135 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:35.889207 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.889209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.890602 (+ 1393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.890602 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.891791 (+ 1189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.891793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.892607 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.892608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.892696 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.892713 (+ 17us) client_negotiation.cc:769] Sending connection context
0806 15:10:35.892789 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 15:10:35.892851 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":281,"mutex_wait_us":66,"thread_start_us":44,"threads_started":1}
I20260806 15:10:35.893399 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.888959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57242 (local address 127.29.69.129:43787)
0806 15:10:35.889170 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.889175 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.889189 (+ 14us) server_negotiation.cc:407] Connection header received
0806 15:10:35.889278 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.889280 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.889296 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.889371 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:35.889591 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.890675 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.891788 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.892521 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.892597 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.892656 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.893273 (+ 617us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.893317 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":86,"threads_started":1}
I20260806 15:10:35.893793 13812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.888533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36655 (local address 127.0.0.1:58636)
0806 15:10:35.888739 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:35.888788 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:35.888878 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:35.889480 (+ 602us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:35.889480 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:35.889483 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:35.889558 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.889560 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.890451 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.890453 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.891790 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:35.891793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.893553 (+ 1760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.893554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:35.893626 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.893630 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:35.893686 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 15:10:35.893726 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"mutex_wait_us":6,"thread_start_us":88,"threads_started":1}
I20260806 15:10:35.893893 13597 tablet_service.cc:1467] Processing CreateTablet for tablet d40d1169566a440c86f8be469897b2aa (DEFAULT_TABLE table=test-table [id=50f761de02bd4b57acb67c03f24fb757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:35.894023 13814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:35.888613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58636 (local address 127.29.69.131:36655)
0806 15:10:35.889265 (+ 652us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:35.889269 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:35.889277 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:35.889314 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:35.889315 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:35.889330 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:35.889401 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:35.889617 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.890289 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.892694 (+ 2405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:35.893462 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:35.893542 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:35.893601 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:35.893901 (+ 300us) server_negotiation.cc:299] Negotiation successful
0806 15:10:35.893948 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":94,"threads_started":1}
I20260806 15:10:35.894251 13597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d40d1169566a440c86f8be469897b2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:35.894688 13462 tablet_service.cc:1467] Processing CreateTablet for tablet d40d1169566a440c86f8be469897b2aa (DEFAULT_TABLE table=test-table [id=50f761de02bd4b57acb67c03f24fb757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:35.894878 13733 tablet_service.cc:1467] Processing CreateTablet for tablet d40d1169566a440c86f8be469897b2aa (DEFAULT_TABLE table=test-table [id=50f761de02bd4b57acb67c03f24fb757]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:35.895054 13462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d40d1169566a440c86f8be469897b2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:35.895177 13733 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d40d1169566a440c86f8be469897b2aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:35.897069 13818 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Bootstrap starting.
I20260806 15:10:35.897711 13818 tablet_bootstrap.cc:654] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:35.898218 13818 log.cc:824] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:35.898434 13820 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Bootstrap starting.
I20260806 15:10:35.899092 13820 tablet_bootstrap.cc:654] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:35.899093 13818 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: No bootstrap required, opened a new log
I20260806 15:10:35.899166 13818 ts_tablet_manager.cc:1397] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260806 15:10:35.899693 13820 log.cc:824] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:35.900022 13819 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap starting.
I20260806 15:10:35.900406 13820 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: No bootstrap required, opened a new log
I20260806 15:10:35.900490 13820 ts_tablet_manager.cc:1397] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:35.900655 13819 tablet_bootstrap.cc:654] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:35.901212 13819 log.cc:824] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:35.901409 13818 raft_consensus.cc:348] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:35.901597 13818 raft_consensus.cc:374] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:35.901643 13818 raft_consensus.cc:729] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03879ab9b54549b69f37b0455d7396b2, State: Initialized, Role: FOLLOWER
I20260806 15:10:35.901798 13818 consensus_queue.cc:260] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:35.902065 13819 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: No bootstrap required, opened a new log
I20260806 15:10:35.902088 13818 ts_tablet_manager.cc:1428] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 15:10:35.902165 13819 ts_tablet_manager.cc:1397] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:35.902225 13664 heartbeater.cc:503] Master 127.29.69.190:35559 was elected leader, sending a full tablet report...
I20260806 15:10:35.902674 13820 raft_consensus.cc:348] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:35.902839 13820 raft_consensus.cc:374] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:35.902877 13820 raft_consensus.cc:729] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82183b4d301349f9af430a04af7a6011, State: Initialized, Role: FOLLOWER
I20260806 15:10:35.902987 13820 consensus_queue.cc:260] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:35.903261 13820 ts_tablet_manager.cc:1428] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:10:35.903278 13800 heartbeater.cc:503] Master 127.29.69.190:35559 was elected leader, sending a full tablet report...
I20260806 15:10:35.904175 13819 raft_consensus.cc:348] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:35.904315 13819 raft_consensus.cc:374] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:35.904361 13819 raft_consensus.cc:729] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb8de98c5f6c4688a39837a6f2fc2dbe, State: Initialized, Role: FOLLOWER
I20260806 15:10:35.904471 13819 consensus_queue.cc:260] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:35.904739 13819 ts_tablet_manager.cc:1428] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:10:35.904779 13528 heartbeater.cc:503] Master 127.29.69.190:35559 was elected leader, sending a full tablet report...
W20260806 15:10:35.938427 13665 tablet.cc:2369] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:10:36.018275 13826 raft_consensus.cc:482] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:36.018414 13826 raft_consensus.cc:504] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:36.018741 13826 leader_election.cc:288] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
I20260806 15:10:36.021596 13814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:36.019115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:34067 (local address 127.29.69.131:36655)
0806 15:10:36.019187 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:36.019189 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:36.019195 (+ 6us) server_negotiation.cc:407] Connection header received
0806 15:10:36.019219 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:36.019220 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:36.019227 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:36.019293 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:36.019455 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.019935 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.020849 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.021238 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.021322 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:36.021331 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:36.021486 (+ 155us) server_negotiation.cc:299] Negotiation successful
0806 15:10:36.021525 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:10:36.021598 13530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:36.018952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36655 (local address 127.29.69.129:34067)
0806 15:10:36.019007 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:36.019023 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:36.019081 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:36.019300 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:36.019301 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:36.019303 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:36.019384 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:36.019386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.020020 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.020021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:36.020759 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:36.020760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.021322 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.021323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:36.021412 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:36.021415 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:10:36.021481 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 15:10:36.021522 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 15:10:36.021901 13816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:36.019047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:41161 (local address 127.29.69.130:37643)
0806 15:10:36.019097 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:36.019100 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:36.019357 (+ 257us) server_negotiation.cc:407] Connection header received
0806 15:10:36.019447 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:36.019448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:36.019460 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:36.019528 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:36.019699 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.020174 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.021099 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.021492 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.021577 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:36.021584 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:36.021784 (+ 200us) server_negotiation.cc:299] Negotiation successful
0806 15:10:36.021833 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:10:36.021912 13753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40d1169566a440c86f8be469897b2aa" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82183b4d301349f9af430a04af7a6011" is_pre_election: true
I20260806 15:10:36.022107 13753 raft_consensus.cc:2454] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 0.
I20260806 15:10:36.022140 13827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:36.018952 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:37643 (local address 127.29.69.129:41161)
0806 15:10:36.019268 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:36.019278 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:36.019361 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:36.019532 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:36.019533 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:36.019534 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:36.019624 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:36.019625 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.020265 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.020266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:36.021005 (+ 739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:36.021007 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.021576 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.021577 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:36.021678 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:36.021683 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:10:36.022014 (+ 331us) client_negotiation.cc:240] Negotiation successful
0806 15:10:36.022064 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":159,"thread_start_us":115,"threads_started":1}
I20260806 15:10:36.022396 13416 leader_election.cc:302] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82183b4d301349f9af430a04af7a6011, fb8de98c5f6c4688a39837a6f2fc2dbe; no voters:
I20260806 15:10:36.022593 13617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40d1169566a440c86f8be469897b2aa" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03879ab9b54549b69f37b0455d7396b2" is_pre_election: true
I20260806 15:10:36.022729 13617 raft_consensus.cc:2454] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 0.
I20260806 15:10:36.022866 13826 raft_consensus.cc:2781] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:10:36.022939 13826 raft_consensus.cc:482] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:10:36.022971 13826 raft_consensus.cc:3037] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:36.023797 13826 raft_consensus.cc:504] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:36.023926 13826 leader_election.cc:288] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 election: Requested vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
I20260806 15:10:36.024099 13753 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40d1169566a440c86f8be469897b2aa" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82183b4d301349f9af430a04af7a6011"
I20260806 15:10:36.024158 13617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d40d1169566a440c86f8be469897b2aa" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03879ab9b54549b69f37b0455d7396b2"
I20260806 15:10:36.024197 13753 raft_consensus.cc:3037] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:36.024261 13617 raft_consensus.cc:3037] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:36.024919 13753 raft_consensus.cc:2454] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 1.
I20260806 15:10:36.024998 13617 raft_consensus.cc:2454] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 1.
I20260806 15:10:36.025144 13416 leader_election.cc:302] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82183b4d301349f9af430a04af7a6011, fb8de98c5f6c4688a39837a6f2fc2dbe; no voters:
I20260806 15:10:36.025259 13826 raft_consensus.cc:2781] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:36.025472 13826 raft_consensus.cc:686] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 LEADER]: Becoming Leader. State: Replica: fb8de98c5f6c4688a39837a6f2fc2dbe, State: Running, Role: LEADER
I20260806 15:10:36.025573 13826 consensus_queue.cc:237] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:36.026396 13334 catalog_manager.cc:5495] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe reported cstate change: term changed from 0 to 1, leader changed from <none> to fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129). New cstate: current_term: 1 leader_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } health_report { overall_health: UNKNOWN } } }
W20260806 15:10:36.029799 13529 tablet.cc:2369] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:10:36.038781 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:36.036435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57252 (local address 127.29.69.129:43787)
0806 15:10:36.036482 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:36.036485 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:36.036496 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:10:36.036539 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:36.036540 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:36.036564 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:36.036640 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:36.036765 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.037216 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.038000 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:36.038199 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:36.038276 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:36.038473 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:36.038570 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:10:36.038665 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:36.038684 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 15:10:36.038706 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:10:36.040465 13753 raft_consensus.cc:1261] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Refusing update from remote peer fb8de98c5f6c4688a39837a6f2fc2dbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:36.040582 13617 raft_consensus.cc:1261] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Refusing update from remote peer fb8de98c5f6c4688a39837a6f2fc2dbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:36.040800 13828 consensus_queue.cc:1035] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:36.040906 13826 consensus_queue.cc:1035] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:36.043848 13833 mvcc.cc:205] Tried to move back new op lower bound from 7315574931619037184 to 7315574931561394176. Current Snapshot: MvccSnapshot[applied={T|T < 7315574931619037184}]
I20260806 15:10:36.045164 13335 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:36.045252 13335 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:36.046018 13335 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Sending DeleteTablet for 3 replicas of tablet d40d1169566a440c86f8be469897b2aa
I20260806 15:10:36.046429 13462 tablet_service.cc:1514] Processing DeleteTablet for tablet d40d1169566a440c86f8be469897b2aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:57242
I20260806 15:10:36.046416 13597 tablet_service.cc:1514] Processing DeleteTablet for tablet d40d1169566a440c86f8be469897b2aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:43610
I20260806 15:10:36.046649 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13397
I20260806 15:10:36.046672 13733 tablet_service.cc:1514] Processing DeleteTablet for tablet d40d1169566a440c86f8be469897b2aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:58636
I20260806 15:10:36.048614 13842 tablet_replica.cc:330] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: stopping tablet replica
I20260806 15:10:36.048724 13842 raft_consensus.cc:2229] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:36.048831 13842 raft_consensus.cc:2258] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:36.049243 13842 ts_tablet_manager.cc:1905] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:36.050433 13840 tablet_replica.cc:330] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: stopping tablet replica
I20260806 15:10:36.050554 13840 raft_consensus.cc:2229] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:36.050652 13840 raft_consensus.cc:2258] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:36.051028 13840 ts_tablet_manager.cc:1905] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:36.051249 13842 ts_tablet_manager.cc:1918] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:36.051327 13842 log.cc:1196] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/d40d1169566a440c86f8be469897b2aa
I20260806 15:10:36.051617 13842 ts_tablet_manager.cc:1939] T d40d1169566a440c86f8be469897b2aa P 82183b4d301349f9af430a04af7a6011: Deleting consensus metadata
I20260806 15:10:36.052042 13321 catalog_manager.cc:4841] TS 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): tablet d40d1169566a440c86f8be469897b2aa (table test-table [id=50f761de02bd4b57acb67c03f24fb757]) successfully deleted
I20260806 15:10:36.052542 13840 ts_tablet_manager.cc:1918] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:36.052632 13840 log.cc:1196] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/d40d1169566a440c86f8be469897b2aa
I20260806 15:10:36.052927 13840 ts_tablet_manager.cc:1939] T d40d1169566a440c86f8be469897b2aa P 03879ab9b54549b69f37b0455d7396b2: Deleting consensus metadata
I20260806 15:10:36.053328 13322 catalog_manager.cc:4841] TS 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): tablet d40d1169566a440c86f8be469897b2aa (table test-table [id=50f761de02bd4b57acb67c03f24fb757]) successfully deleted
W20260806 15:10:36.053990 13321 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:43787 (error 108)
I20260806 15:10:36.054554 13812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:36.054417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:43787 (local address 127.0.0.1:57264)
0806 15:10:36.054470 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:36.054507 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:43787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260806 15:10:36.054636 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13533
W20260806 15:10:36.054703 13321 catalog_manager.cc:4584] TS fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129:43787): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d40d1169566a440c86f8be469897b2aa: Network error: Client connection negotiation failed: client connection to 127.29.69.129:43787: connect: Connection refused (error 111)
I20260806 15:10:36.062037 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13669
I20260806 15:10:36.067195 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13302
I20260806 15:10:56.073109 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35559
--webserver_interface=127.29.69.190
--webserver_port=41353
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:35559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:10:56.154167 13844 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:56.154428 13844 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:56.154467 13844 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:56.155612 13844 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 15:10:56.155674 13844 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 15:10:56.155699 13844 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 15:10:56.155730 13844 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:10:56.155756 13844 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:56.155786 13844 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:56.155809 13844 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:10:56.155835 13844 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:10:56.157300 13844 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:35559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=41353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13844
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:56.157578 13844 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:56.157801 13844 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:56.166491 13850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:56.166519 13853 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:56.166540 13844 server_base.cc:1034] running on GCE node
W20260806 15:10:56.166504 13851 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:56.167073 13844 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:56.167400 13844 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:56.168561 13844 hybrid_clock.cc:648] HybridClock initialized: now 1786029056168558 us; error 38 us; skew 500 ppm
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:56.171306 13844 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:10:56.171792 13844 webserver.cc:460] Webserver started at http://127.29.69.190:41353/ using document root <none> and password file <none>
I20260806 15:10:56.172050 13844 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:56.172111 13844 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:56.173578 13844 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:56.174409 13860 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.174597 13844 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:56.174710 13844 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "931e059c1a144df0a796dfaaea4d4954"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "56258f84997eee9d57d71713fcd6d69b"
server_key_iv: "554193b1eff584201a05d22bf34ece0f"
server_key_version: "encryptionkey@0"
I20260806 15:10:56.175148 13844 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:56.187639 13844 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:56.189954 13844 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:56.190119 13844 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:56.194357 13844 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:35559
I20260806 15:10:56.194380 13914 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:35559 every 8 connection(s)
I20260806 15:10:56.194845 13844 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:10:56.196341 13915 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:10:56.196951 13915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap starting.
I20260806 15:10:56.198555 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13844
I20260806 15:10:56.198939 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:43787
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:35559
--webserver_port=35189
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:56.206754 13915 log.cc:824] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:56.208673 13915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:56.209002 13915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap complete.
I20260806 15:10:56.211372 13915 raft_consensus.cc:348] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:56.211603 13915 raft_consensus.cc:729] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931e059c1a144df0a796dfaaea4d4954, State: Initialized, Role: FOLLOWER
I20260806 15:10:56.211774 13915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:56.211833 13915 raft_consensus.cc:388] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:10:56.211902 13915 raft_consensus.cc:482] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:10:56.211956 13915 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 1 FOLLOWER]: Advancing to term 2
I20260806 15:10:56.213088 13915 raft_consensus.cc:504] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:56.213202 13915 leader_election.cc:302] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 931e059c1a144df0a796dfaaea4d4954; no voters:
I20260806 15:10:56.213410 13915 leader_election.cc:288] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260806 15:10:56.213446 13919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Leader election won for term 2
I20260806 15:10:56.213565 13919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 LEADER]: Becoming Leader. State: Replica: 931e059c1a144df0a796dfaaea4d4954, State: Running, Role: LEADER
I20260806 15:10:56.213697 13915 sys_catalog.cc:564] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:10:56.213725 13919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:10:56.214033 13919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931e059c1a144df0a796dfaaea4d4954. Latest consensus state: current_term: 2 leader_uuid: "931e059c1a144df0a796dfaaea4d4954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } } }
I20260806 15:10:56.214036 13920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "931e059c1a144df0a796dfaaea4d4954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } } }
I20260806 15:10:56.214114 13919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:56.214164 13920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: This master's current role is: LEADER
I20260806 15:10:56.214587 13924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:10:56.215404 13924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:10:56.215508 13924 catalog_manager.cc:1259] Loaded cluster ID: 44002fa210574bd080d3038ad2ccc62e
I20260806 15:10:56.215536 13924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:10:56.216789 13924 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:10:56.216982 13924 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Loaded TSK: 0
I20260806 15:10:56.231923 13924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Generated new TSK 1
I20260806 15:10:56.232031 13924 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:10:56.287796 13917 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:56.288017 13917 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:56.288057 13917 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:56.289203 13917 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:56.289271 13917 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:56.289317 13917 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:10:56.290861 13917 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:43787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=35189
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13917
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:56.291123 13917 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:56.291360 13917 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:56.297314 13943 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:56.297346 13942 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:56.297346 13945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:56.297935 13917 server_base.cc:1034] running on GCE node
I20260806 15:10:56.298151 13917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:56.298444 13917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:56.299633 13917 hybrid_clock.cc:648] HybridClock initialized: now 1786029056299609 us; error 40 us; skew 500 ppm
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:56.302151 13917 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:10:56.302687 13917 webserver.cc:460] Webserver started at http://127.29.69.129:35189/ using document root <none> and password file <none>
I20260806 15:10:56.302943 13917 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:56.303004 13917 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:56.304347 13917 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:56.305043 13953 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.305214 13917 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:56.305320 13917 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "53f81a800fdb7e618bb184007b97c985"
server_key_iv: "4d14ec62e601c86ae239e7a359a05dca"
server_key_version: "encryptionkey@0"
I20260806 15:10:56.305681 13917 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:56.328403 13917 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:56.330752 13917 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:56.330904 13917 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:56.331157 13917 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:56.331645 13960 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:10:56.333622 13917 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:10:56.333695 13917 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 15:10:56.333746 13917 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:10:56.334438 13917 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:10:56.334501 13917 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:56.334550 13960 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap starting.
I20260806 15:10:56.341981 13917 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:43787
I20260806 15:10:56.342451 13917 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:10:56.342610 14069 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:43787 every 8 connection(s)
I20260806 15:10:56.344637 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 13917
I20260806 15:10:56.344946 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:37643
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:35559
--webserver_port=36623
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:10:56.345686 13960 log.cc:824] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:56.348904 13960 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:10:56.349233 13960 tablet_bootstrap.cc:492] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap complete.
I20260806 15:10:56.350533 13960 ts_tablet_manager.cc:1397] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent bootstrapping tablet: real 0.016s user 0.000s sys 0.015s
I20260806 15:10:56.351917 13960 raft_consensus.cc:348] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:56.352308 13960 raft_consensus.cc:729] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb8de98c5f6c4688a39837a6f2fc2dbe, State: Initialized, Role: FOLLOWER
I20260806 15:10:56.352461 13960 consensus_queue.cc:260] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } }
I20260806 15:10:56.352720 13960 ts_tablet_manager.cc:1428] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:56.362749 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.346411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:60039)
0806 15:10:56.346588 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.346638 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.347352 (+ 714us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.351147 (+ 3795us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.351152 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.351591 (+ 439us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:56.351898 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.351906 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.354015 (+ 2109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.354017 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.355307 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.355310 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.356209 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.356210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.356351 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.357004 (+ 653us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:56.357013 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:56.358785 (+ 1772us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:56.360928 (+ 2143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.360935 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.360937 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.361234 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.361511 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.361512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.361512 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.361641 (+ 129us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.362073 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:56.362079 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:56.362225 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.362369 (+ 144us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.362541 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":83,"threads_started":1}
I20260806 15:10:56.362782 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.346682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:60039 (local address 127.29.69.190:35559)
0806 15:10:56.350460 (+ 3778us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.350472 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.350520 (+ 48us) server_negotiation.cc:407] Connection header received
0806 15:10:56.350734 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.350744 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.350810 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.350979 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:56.352072 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.353873 (+ 1801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.355410 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.356103 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.356231 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.358901 (+ 2670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:56.358906 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:56.358906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:56.358921 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:56.360831 (+ 1910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.361322 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.361325 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.361325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.361438 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.361714 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.361715 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.361715 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.361998 (+ 283us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:56.362086 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.362434 (+ 348us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.362589 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3716,"thread_start_us":85,"threads_started":1}
I20260806 15:10:56.363739 14070 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35559
I20260806 15:10:56.363847 14070 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:56.364029 14070 heartbeater.cc:511] Master 127.29.69.190:35559 requested a full tablet report, sending...
I20260806 15:10:56.364745 13878 ts_manager.cc:194] Registered new tserver with Master: fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129:43787)
I20260806 15:10:56.365911 13878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:60039
I20260806 15:10:56.366842 14070 heartbeater.cc:503] Master 127.29.69.190:35559 was elected leader, sending a full tablet report...
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.129@KRBTEST.COM
I20260806 15:10:56.373764 14077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.365320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:43787 (local address 127.0.0.1:51920)
0806 15:10:56.365552 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.365581 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.365638 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.365905 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.365912 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.366254 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:56.366342 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.366345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.367515 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.367516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.368425 (+ 909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.368428 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.368860 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.368861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.368946 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.369379 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:56.369384 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:56.370865 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:56.372580 (+ 1715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.372588 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.372590 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.372790 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.373026 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.373027 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.373027 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.373093 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.373373 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:56.373380 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:56.373431 (+ 51us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.373533 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.373661 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":107,"threads_started":1}
I20260806 15:10:56.373764 14078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.365405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51920 (local address 127.29.69.129:43787)
0806 15:10:56.365753 (+ 348us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.365758 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.365766 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:56.365795 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.365796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.365810 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.365877 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:56.366412 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.367440 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.368507 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.368781 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.368836 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.370976 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:56.370988 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:56.370989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:56.370994 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:56.372476 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.372876 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.372879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.372880 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.372940 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.373159 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.373160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.373160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.373297 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:56.373392 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.373587 (+ 195us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.373675 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":86,"threads_started":1}
I20260806 15:10:56.374158 14002 tablet_service.cc:1514] Processing DeleteTablet for tablet d40d1169566a440c86f8be469897b2aa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:51920
I20260806 15:10:56.374761 14079 tablet_replica.cc:330] stopping tablet replica
I20260806 15:10:56.374872 14079 raft_consensus.cc:2229] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:56.374938 14079 raft_consensus.cc:2258] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:56.375257 14079 ts_tablet_manager.cc:1905] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:56.377624 14079 ts_tablet_manager.cc:1918] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:56.377701 14079 log.cc:1196] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal/wals/d40d1169566a440c86f8be469897b2aa
I20260806 15:10:56.377928 14079 ts_tablet_manager.cc:1939] T d40d1169566a440c86f8be469897b2aa P fb8de98c5f6c4688a39837a6f2fc2dbe: Deleting consensus metadata
I20260806 15:10:56.378669 13863 catalog_manager.cc:4841] TS fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129:43787): tablet d40d1169566a440c86f8be469897b2aa (table test-table [id=50f761de02bd4b57acb67c03f24fb757]) successfully deleted
W20260806 15:10:56.434767 14073 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:56.434960 14073 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:56.434983 14073 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:56.436044 14073 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:56.436076 14073 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:56.436101 14073 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:10:56.437435 14073 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:37643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=36623
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14073
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:56.437629 14073 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:56.437794 14073 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:56.442746 14087 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:56.442757 14073 server_base.cc:1034] running on GCE node
W20260806 15:10:56.442713 14084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:56.442727 14085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:56.443157 14073 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:56.443439 14073 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:56.444602 14073 hybrid_clock.cc:648] HybridClock initialized: now 1786029056444591 us; error 38 us; skew 500 ppm
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:56.446978 14073 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:10:56.447430 14073 webserver.cc:460] Webserver started at http://127.29.69.130:36623/ using document root <none> and password file <none>
I20260806 15:10:56.447649 14073 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:56.447726 14073 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:56.449043 14073 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:56.449672 14095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.449855 14073 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:56.449952 14073 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "03879ab9b54549b69f37b0455d7396b2"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "bb92e33f6947c58db4641e7f990f2d83"
server_key_iv: "95c6b8fca6df07b46fbd5f0adbcf04e5"
server_key_version: "encryptionkey@0"
I20260806 15:10:56.450299 14073 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:56.469796 14073 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:56.471692 14073 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:56.471849 14073 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:56.472090 14073 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:56.472399 14073 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:56.472450 14073 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.472486 14073 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:56.472514 14073 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.478689 14073 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:37643
I20260806 15:10:56.478742 14209 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:37643 every 8 connection(s)
I20260806 15:10:56.479074 14073 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:10:56.482146 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14073
I20260806 15:10:56.482470 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:36655
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:35559
--webserver_port=43419
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:56.489269 14212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.479732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:46603)
0806 15:10:56.479885 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.479919 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.480378 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.480595 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.480598 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.481145 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:56.481329 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.481333 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.482032 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.482033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.483384 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.483388 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.483786 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.483787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.483947 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.484504 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:56.484513 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:56.486090 (+ 1577us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:56.487968 (+ 1878us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.487975 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.487976 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.488184 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.488398 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.488399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.488399 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.488504 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.488805 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:56.488809 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:56.488918 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.488999 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.489115 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":92,"threads_started":1}
I20260806 15:10:56.489290 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.479727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:46603 (local address 127.29.69.190:35559)
0806 15:10:56.479768 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.479770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.479991 (+ 221us) server_negotiation.cc:407] Connection header received
0806 15:10:56.480479 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.480480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.480493 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.480546 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:56.481408 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.481912 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.483488 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.483695 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.483755 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.486191 (+ 2436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:56.486193 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:56.486193 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:56.486202 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:56.487885 (+ 1683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.488261 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.488263 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.488264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.488328 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.488572 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.488574 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.488574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.488732 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:56.488813 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.489049 (+ 236us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.489154 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:10:56.489857 14210 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35559
I20260806 15:10:56.489948 14210 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:56.490139 14210 heartbeater.cc:511] Master 127.29.69.190:35559 requested a full tablet report, sending...
I20260806 15:10:56.490561 13878 ts_manager.cc:194] Registered new tserver with Master: 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
I20260806 15:10:56.490890 13878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:46603
W20260806 15:10:56.564671 14213 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:10:56.564913 14213 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:10:56.564961 14213 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:10:56.566152 14213 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:10:56.566226 14213 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:10:56.566270 14213 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:10:56.567765 14213 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:36655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=43419
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14213
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:10:56.568048 14213 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:10:56.568277 14213 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:10:56.573426 14221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:56.573470 14218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:10:56.573427 14219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:10:56.573444 14213 server_base.cc:1034] running on GCE node
I20260806 15:10:56.573848 14213 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:10:56.574098 14213 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:10:56.575259 14213 hybrid_clock.cc:648] HybridClock initialized: now 1786029056575222 us; error 61 us; skew 500 ppm
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:10:56.577924 14213 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:10:56.578467 14213 webserver.cc:460] Webserver started at http://127.29.69.131:43419/ using document root <none> and password file <none>
I20260806 15:10:56.578708 14213 fs_manager.cc:359] Metadata directory not provided
I20260806 15:10:56.578794 14213 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:10:56.580094 14213 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:10:56.580678 14229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.580873 14213 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:10:56.581024 14213 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "82183b4d301349f9af430a04af7a6011"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "8e938113adc60e833121bf3472e24852"
server_key_iv: "a7f64d9450fac6451fa6bdad67dc6a45"
server_key_version: "encryptionkey@0"
I20260806 15:10:56.581374 14213 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:10:56.607995 14213 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:10:56.610224 14213 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:10:56.610430 14213 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:10:56.610687 14213 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:10:56.611006 14213 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:10:56.611060 14213 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.611109 14213 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:10:56.611132 14213 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:10:56.617194 14213 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36655
I20260806 15:10:56.617245 14342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36655 every 8 connection(s)
I20260806 15:10:56.617586 14213 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:10:56.618287 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14213
Aug 06 15:10:56 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029056, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:10:56.631286 14347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.618756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34702 (local address 127.29.69.190:35559)
0806 15:10:56.618884 (+ 128us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.618886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.618972 (+ 86us) server_negotiation.cc:407] Connection header received
0806 15:10:56.619050 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.619051 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.619062 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.619127 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:56.619740 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.620263 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.621041 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.621260 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.621336 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.628230 (+ 6894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:56.628232 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:56.628233 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:56.628239 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:56.630056 (+ 1817us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.630458 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.630459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.630460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.630527 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.630730 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.630731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.630732 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.630856 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:56.631054 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.631093 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.631174 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":74,"threads_started":1}
I20260806 15:10:56.632084 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.618346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:40009 (local address 127.29.69.190:35559)
0806 15:10:56.618401 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.618402 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.618725 (+ 323us) server_negotiation.cc:407] Connection header received
0806 15:10:56.619287 (+ 562us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.619288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.619301 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.619357 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:56.620284 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.620772 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.621833 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.622012 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.622066 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.629201 (+ 7135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:56.629202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:56.629203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:56.629210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:56.630674 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.631067 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.631068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.631068 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.631132 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.631448 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.631449 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.631450 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.631564 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:56.631633 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.631911 (+ 278us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.631998 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:10:56.632279 14345 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.618372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:40009)
0806 15:10:56.618574 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.618625 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.619180 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.619437 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.619440 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.619992 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:10:56.620183 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.620188 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.620878 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.620879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.621754 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.621757 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.622092 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.622093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.622199 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.627572 (+ 5373us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:10:56.627581 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:10:56.629109 (+ 1528us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:10:56.630758 (+ 1649us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.630765 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.630766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.630974 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.631197 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:10:56.631198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:10:56.631199 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:10:56.631384 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:10:56.631629 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:10:56.631638 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:10:56.631779 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.631891 (+ 112us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.632054 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":94,"threads_started":1}
I20260806 15:10:56.632702 14343 heartbeater.cc:347] Connected to a master server at 127.29.69.190:35559
I20260806 15:10:56.632802 14343 heartbeater.cc:464] Registering TS with master...
I20260806 15:10:56.632979 14343 heartbeater.cc:511] Master 127.29.69.190:35559 requested a full tablet report, sending...
I20260806 15:10:56.633404 13878 ts_manager.cc:194] Registered new tserver with Master: 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655)
I20260806 15:10:56.633791 13878 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:40009
I20260806 15:10:56.642824 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:10:56.645395 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.643203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34708 (local address 127.29.69.190:35559)
0806 15:10:56.643240 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.643242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.643370 (+ 128us) server_negotiation.cc:407] Connection header received
0806 15:10:56.643435 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.643435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.643466 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.643518 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:56.643635 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.644086 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.644804 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.644992 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.645045 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.645176 (+ 131us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:56.645214 (+ 38us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0806 15:10:56.645320 (+ 106us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:34708: token expired
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 15:10:56.645468 14075 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34708: token expired
W20260806 15:10:56.645643 13806 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.29.69.190:35559)
I20260806 15:10:56.651404 14075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.645913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34720 (local address 127.29.69.190:35559)
0806 15:10:56.645943 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.645945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.645953 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:10:56.645972 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.645972 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.645980 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.646034 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:10:56.646556 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.646992 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.647731 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.647924 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.647980 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.649016 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:10:56.649017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:10:56.649017 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:10:56.649023 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:10:56.650487 (+ 1464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.650785 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.650786 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.650786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.650834 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:10:56.650996 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:10:56.650996 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:10:56.650996 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:10:56.651086 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:10:56.651158 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.651298 (+ 140us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.651350 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260806 15:10:56.652614 13878 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:10:56.654443 13878 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:10:56.656766 14002 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea (DEFAULT_TABLE table=test-table [id=183c04c256404e14a89a722f3206756f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:56.656999 14002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:56.658578 13960 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap starting.
I20260806 15:10:56.658915 13960 tablet_bootstrap.cc:654] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:56.659804 13960 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: No bootstrap required, opened a new log
I20260806 15:10:56.659869 13960 ts_tablet_manager.cc:1397] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260806 15:10:56.660029 13960 raft_consensus.cc:348] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.660104 13960 raft_consensus.cc:374] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:56.660148 13960 raft_consensus.cc:729] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb8de98c5f6c4688a39837a6f2fc2dbe, State: Initialized, Role: FOLLOWER
I20260806 15:10:56.660203 13960 consensus_queue.cc:260] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.660302 13960 ts_tablet_manager.cc:1428] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260806 15:10:56.660354 14077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.656326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:37643 (local address 127.0.0.1:54612)
0806 15:10:56.656373 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.656384 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.656423 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.656925 (+ 502us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.656926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.656928 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:56.656970 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.656972 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.658165 (+ 1193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.658165 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.659041 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.659043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.660064 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.660065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.660144 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.660169 (+ 25us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.660231 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.660283 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 15:10:56.660389 14350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.656473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54612 (local address 127.29.69.130:37643)
0806 15:10:56.656745 (+ 272us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.656750 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.656760 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:56.656802 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.656804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.656820 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.656907 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:56.657036 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.658074 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.659194 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.659918 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.660040 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.660103 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.660267 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.660309 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":230,"thread_start_us":102,"threads_started":1}
I20260806 15:10:56.661155 14143 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea (DEFAULT_TABLE table=test-table [id=183c04c256404e14a89a722f3206756f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:56.661522 14143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:56.662482 14349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.656327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36655 (local address 127.0.0.1:37424)
0806 15:10:56.656509 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.656521 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.656579 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.659091 (+ 2512us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.659092 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.659094 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:56.659138 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.659140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.660554 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.660555 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.661419 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.661422 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.662199 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.662200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.662268 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.662272 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.662356 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.662399 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"mutex_wait_us":12,"thread_start_us":107,"threads_started":1}
I20260806 15:10:56.662494 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.656534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37424 (local address 127.29.69.131:36655)
0806 15:10:56.658814 (+ 2280us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.658819 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.658830 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:10:56.658866 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.658867 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.658883 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.658981 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:56.659435 (+ 454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.660481 (+ 1046us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.661509 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.662098 (+ 589us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.662182 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.662235 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.662372 (+ 137us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.662409 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2242,"thread_start_us":84,"threads_started":1}
I20260806 15:10:56.663093 14277 tablet_service.cc:1467] Processing CreateTablet for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea (DEFAULT_TABLE table=test-table [id=183c04c256404e14a89a722f3206756f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:10:56.663391 14277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:10:56.664654 14353 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Bootstrap starting.
I20260806 15:10:56.665366 14353 tablet_bootstrap.cc:654] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:56.665984 14353 log.cc:824] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:56.666704 14355 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Bootstrap starting.
I20260806 15:10:56.666839 14353 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: No bootstrap required, opened a new log
I20260806 15:10:56.666937 14353 ts_tablet_manager.cc:1397] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:56.667326 14355 tablet_bootstrap.cc:654] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Neither blocks nor log segments found. Creating new log.
I20260806 15:10:56.667868 14355 log.cc:824] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Log is configured to *not* fsync() on all Append() calls
I20260806 15:10:56.668628 14355 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: No bootstrap required, opened a new log
I20260806 15:10:56.668557 14353 raft_consensus.cc:348] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.668684 14353 raft_consensus.cc:374] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:56.668711 14355 ts_tablet_manager.cc:1397] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:10:56.668727 14353 raft_consensus.cc:729] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03879ab9b54549b69f37b0455d7396b2, State: Initialized, Role: FOLLOWER
I20260806 15:10:56.668853 14353 consensus_queue.cc:260] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.669133 14353 ts_tablet_manager.cc:1428] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 15:10:56.669147 14210 heartbeater.cc:503] Master 127.29.69.190:35559 was elected leader, sending a full tablet report...
I20260806 15:10:56.670492 14355 raft_consensus.cc:348] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.670642 14355 raft_consensus.cc:374] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:10:56.670691 14355 raft_consensus.cc:729] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82183b4d301349f9af430a04af7a6011, State: Initialized, Role: FOLLOWER
I20260806 15:10:56.670809 14355 consensus_queue.cc:260] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.671065 14355 ts_tablet_manager.cc:1428] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260806 15:10:56.671133 14343 heartbeater.cc:503] Master 127.29.69.190:35559 was elected leader, sending a full tablet report...
I20260806 15:10:56.674152 14076 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:10:56.674250 14076 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.674612 14076 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
I20260806 15:10:56.677402 14074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.674754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36655 (local address 127.29.69.129:41887)
0806 15:10:56.674809 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.674819 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.674872 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.675020 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.675020 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.675022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:56.675071 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.675073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.675669 (+ 596us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.675671 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.676511 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.676513 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.677115 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.677116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.677199 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.677218 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.677288 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.677333 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 15:10:56.677398 14351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.674810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:41887 (local address 127.29.69.131:36655)
0806 15:10:56.674854 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.674856 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.674866 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:10:56.674941 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.674942 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.674959 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.675015 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:56.675127 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.675587 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.676614 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.677024 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.677115 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.677124 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.677302 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.677336 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:10:56.677657 14350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.674869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:48695 (local address 127.29.69.130:37643)
0806 15:10:56.674910 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.674912 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.675040 (+ 128us) server_negotiation.cc:407] Connection header received
0806 15:10:56.675104 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.675105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.675114 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.675167 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:10:56.675328 (+ 161us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.675784 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.676791 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.677199 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.677283 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.677293 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.677556 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.677599 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:10:56.677700 14297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfe2e2edfc34bd7a4dd980fbd978dea" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82183b4d301349f9af430a04af7a6011" is_pre_election: true
I20260806 15:10:56.677820 14297 raft_consensus.cc:2454] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 0.
I20260806 15:10:56.677902 14359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.674759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:37643 (local address 127.29.69.129:48695)
0806 15:10:56.674972 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.674980 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:10:56.675055 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:10:56.675171 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:10:56.675172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:10:56.675173 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:10:56.675263 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.675264 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.675875 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.675876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.676707 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:10:56.676710 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.677299 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.677300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:10:56.677398 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.677401 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:10:56.677764 (+ 363us) client_negotiation.cc:240] Negotiation successful
0806 15:10:56.677807 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":90,"threads_started":1}
I20260806 15:10:56.678076 13956 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82183b4d301349f9af430a04af7a6011, fb8de98c5f6c4688a39837a6f2fc2dbe; no voters:
I20260806 15:10:56.678195 14076 raft_consensus.cc:2781] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:10:56.678292 14076 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:10:56.678339 14076 raft_consensus.cc:3037] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:56.678341 14163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfe2e2edfc34bd7a4dd980fbd978dea" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03879ab9b54549b69f37b0455d7396b2" is_pre_election: true
I20260806 15:10:56.678475 14163 raft_consensus.cc:2454] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 0.
I20260806 15:10:56.679191 14076 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.679338 14076 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 election: Requested vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
I20260806 15:10:56.679481 14163 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfe2e2edfc34bd7a4dd980fbd978dea" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03879ab9b54549b69f37b0455d7396b2"
I20260806 15:10:56.679517 14297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bfe2e2edfc34bd7a4dd980fbd978dea" candidate_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82183b4d301349f9af430a04af7a6011"
I20260806 15:10:56.679576 14297 raft_consensus.cc:3037] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:56.679569 14163 raft_consensus.cc:3037] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:10:56.680425 14163 raft_consensus.cc:2454] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 1.
I20260806 15:10:56.680425 14297 raft_consensus.cc:2454] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb8de98c5f6c4688a39837a6f2fc2dbe in term 1.
I20260806 15:10:56.680596 13957 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03879ab9b54549b69f37b0455d7396b2, fb8de98c5f6c4688a39837a6f2fc2dbe; no voters:
I20260806 15:10:56.680703 14076 raft_consensus.cc:2781] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:10:56.680857 14076 raft_consensus.cc:686] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 LEADER]: Becoming Leader. State: Replica: fb8de98c5f6c4688a39837a6f2fc2dbe, State: Running, Role: LEADER
I20260806 15:10:56.680938 14076 consensus_queue.cc:237] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:10:56.681665 13878 catalog_manager.cc:5495] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe reported cstate change: term changed from 0 to 1, leader changed from <none> to fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129). New cstate: current_term: 1 leader_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } health_report { overall_health: HEALTHY } } }
I20260806 15:10:56.687690 14078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.685582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51926 (local address 127.29.69.129:43787)
0806 15:10:56.685621 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:10:56.685622 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:10:56.685661 (+ 39us) server_negotiation.cc:407] Connection header received
0806 15:10:56.685728 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:10:56.685729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:10:56.685744 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:10:56.685801 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:10:56.685898 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.686407 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.687073 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:10:56.687260 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:10:56.687308 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:10:56.687424 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:10:56.687517 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:10:56.687564 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 15:10:56.687627 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 15:10:56.687643 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:10:56.689072 14163 raft_consensus.cc:1261] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Refusing update from remote peer fb8de98c5f6c4688a39837a6f2fc2dbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:56.689095 14297 raft_consensus.cc:1261] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Refusing update from remote peer fb8de98c5f6c4688a39837a6f2fc2dbe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:10:56.689404 14360 consensus_queue.cc:1035] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:56.689565 14076 consensus_queue.cc:1035] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [LEADER]: Connected to new peer: Peer: permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:10:56.692130 14362 mvcc.cc:205] Tried to move back new op lower bound from 7315575016196136960 to 7315575016165675008. Current Snapshot: MvccSnapshot[applied={T|T < 7315575016196136960}]
I20260806 15:10:56.692941 14363 mvcc.cc:205] Tried to move back new op lower bound from 7315575016196136960 to 7315575016165675008. Current Snapshot: MvccSnapshot[applied={T|T < 7315575016196136960}]
I20260806 15:10:56.694084 13877 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:56.694180 13877 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:10:56.695001 13877 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Sending DeleteTablet for 3 replicas of tablet 9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:10:56.695345 14002 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:56 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:51920
I20260806 15:10:56.695358 14143 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:56 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:54612
I20260806 15:10:56.695413 14277 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:10:56 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:37424
I20260806 15:10:56.695448 14079 tablet_replica.cc:330] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: stopping tablet replica
I20260806 15:10:56.695520 14079 raft_consensus.cc:2229] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:10:56.695580 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13917
I20260806 15:10:56.695613 14079 raft_consensus.cc:2258] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:56.695667 14372 tablet_replica.cc:330] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: stopping tablet replica
I20260806 15:10:56.695758 14372 raft_consensus.cc:2229] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:56.695842 14372 raft_consensus.cc:2258] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:56.695978 14373 tablet_replica.cc:330] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: stopping tablet replica
I20260806 15:10:56.696050 14373 raft_consensus.cc:2229] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:10:56.696123 14373 raft_consensus.cc:2258] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:10:56.696630 14373 ts_tablet_manager.cc:1905] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:56.698005 14372 ts_tablet_manager.cc:1905] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:10:56.698055 14373 ts_tablet_manager.cc:1918] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:56.698143 14373 log.cc:1196] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:10:56.698478 14373 ts_tablet_manager.cc:1939] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 82183b4d301349f9af430a04af7a6011: Deleting consensus metadata
I20260806 15:10:56.698876 13863 catalog_manager.cc:4841] TS 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): tablet 9bfe2e2edfc34bd7a4dd980fbd978dea (table test-table [id=183c04c256404e14a89a722f3206756f]) successfully deleted
I20260806 15:10:56.700049 14372 ts_tablet_manager.cc:1918] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:10:56.700126 14372 log.cc:1196] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:10:56.700392 14372 ts_tablet_manager.cc:1939] T 9bfe2e2edfc34bd7a4dd980fbd978dea P 03879ab9b54549b69f37b0455d7396b2: Deleting consensus metadata
I20260806 15:10:56.700964 13864 catalog_manager.cc:4841] TS 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): tablet 9bfe2e2edfc34bd7a4dd980fbd978dea (table test-table [id=183c04c256404e14a89a722f3206756f]) successfully deleted
W20260806 15:10:56.703923 13863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:43787 (error 108)
I20260806 15:10:56.704099 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 14073
I20260806 15:10:56.705093 14349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:10:56.704966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:43787 (local address 127.0.0.1:51936)
0806 15:10:56.705013 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:10:56.705051 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:43787: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 15:10:56.705210 13863 catalog_manager.cc:4584] TS fb8de98c5f6c4688a39837a6f2fc2dbe (127.29.69.129:43787): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9bfe2e2edfc34bd7a4dd980fbd978dea: Network error: Client connection negotiation failed: client connection to 127.29.69.129:43787: connect: Connection refused (error 111)
I20260806 15:10:56.709908 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 14213
I20260806 15:10:56.717288 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 13844
I20260806 15:11:16.723775 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35559
--webserver_interface=127.29.69.190
--webserver_port=41353
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:35559
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:16.804881 14375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:16.805086 14375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:16.805109 14375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:16.806321 14375 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260806 15:11:16.806358 14375 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260806 15:11:16.806371 14375 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260806 15:11:16.806383 14375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:16.806438 14375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:16.806466 14375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:16.806490 14375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:16.806511 14375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:16.808003 14375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:35559
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35559
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=41353
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:16.808249 14375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:16.808501 14375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:16.813345 14383 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:16.813422 14375 server_base.cc:1034] running on GCE node
W20260806 15:11:16.813387 14381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:16.813344 14380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:16.813879 14375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:16.814129 14375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:16.815270 14375 hybrid_clock.cc:648] HybridClock initialized: now 1786029076815248 us; error 38 us; skew 500 ppm
Aug 06 15:11:16 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029076, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:16.821120 14375 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:11:16.821561 14375 webserver.cc:460] Webserver started at http://127.29.69.190:41353/ using document root <none> and password file <none>
I20260806 15:11:16.821786 14375 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:16.821833 14375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:16.823289 14375 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:16.823983 14390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:16.824164 14375 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:16.824272 14375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "931e059c1a144df0a796dfaaea4d4954"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "56258f84997eee9d57d71713fcd6d69b"
server_key_iv: "554193b1eff584201a05d22bf34ece0f"
server_key_version: "encryptionkey@0"
I20260806 15:11:16.824615 14375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:16.833755 14375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:16.835997 14375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:16.836156 14375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:16.840066 14375 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:35559
I20260806 15:11:16.840142 14442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:35559 every 8 connection(s)
I20260806 15:11:16.840488 14375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:16.841894 14443 sys_catalog.cc:263] Verifying existing consensus state
I20260806 15:11:16.842509 14443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap starting.
I20260806 15:11:16.848886 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14375
I20260806 15:11:16.849185 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:43787
--local_ip_for_outbound_sockets=127.29.69.129
--tserver_master_addrs=127.29.69.190:35559
--webserver_port=35189
--webserver_interface=127.29.69.129
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:11:16.851423 14443 log.cc:824] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:16.853530 14443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:11:16.853838 14443 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Bootstrap complete.
I20260806 15:11:16.856150 14443 raft_consensus.cc:348] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:11:16.856360 14443 raft_consensus.cc:729] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 931e059c1a144df0a796dfaaea4d4954, State: Initialized, Role: FOLLOWER
I20260806 15:11:16.856526 14443 consensus_queue.cc:260] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:11:16.856607 14443 raft_consensus.cc:388] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:16.856662 14443 raft_consensus.cc:482] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:16.856732 14443 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 2 FOLLOWER]: Advancing to term 3
I20260806 15:11:16.857704 14443 raft_consensus.cc:504] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:11:16.857823 14443 leader_election.cc:302] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 931e059c1a144df0a796dfaaea4d4954; no voters:
I20260806 15:11:16.858031 14443 leader_election.cc:288] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260806 15:11:16.858064 14447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 3 FOLLOWER]: Leader election won for term 3
I20260806 15:11:16.858184 14447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [term 3 LEADER]: Becoming Leader. State: Replica: 931e059c1a144df0a796dfaaea4d4954, State: Running, Role: LEADER
I20260806 15:11:16.858315 14443 sys_catalog.cc:564] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:16.858364 14447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } }
I20260806 15:11:16.858779 14448 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "931e059c1a144df0a796dfaaea4d4954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } } }
I20260806 15:11:16.858794 14449 sys_catalog.cc:455] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 931e059c1a144df0a796dfaaea4d4954. Latest consensus state: current_term: 3 leader_uuid: "931e059c1a144df0a796dfaaea4d4954" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "931e059c1a144df0a796dfaaea4d4954" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35559 } } }
I20260806 15:11:16.858882 14448 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:16.858903 14449 sys_catalog.cc:458] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:16.859099 14456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:16.860008 14456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:16.860179 14456 catalog_manager.cc:1259] Loaded cluster ID: 44002fa210574bd080d3038ad2ccc62e
I20260806 15:11:16.860416 14456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:16.861227 14456 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:16.861413 14456 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Loaded TSK: 0
I20260806 15:11:16.861469 14456 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 931e059c1a144df0a796dfaaea4d4954: Loaded TSK: 1
F20260806 15:11:16.861702 14456 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f5d4bdee9ad google::LogMessage::Fail() at ??:0
@ 0x7f5d4bdf188a google::LogMessage::SendToLog() at ??:0
@ 0x7f5d4bdee4de google::LogMessage::Flush() at ??:0
@ 0x7f5d4bdefa19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f5d4e55b104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f5d4e558d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f5d53d481cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f5d53d4848e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f5d53d48594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f5d53d0ec48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f5d53d18ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f5d4dcbc0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f5d4dcb1954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f5d4eb156db start_thread at ??:0
@ 0x7f5d4a8ec61f clone at ??:0
W20260806 15:11:16.951373 14445 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:16.951571 14445 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:16.951594 14445 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:16.952730 14445 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:16.952770 14445 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:16.952796 14445 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:16.954239 14445 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:43787
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=35189
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14445
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:16.954531 14445 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:16.954767 14445 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:16.959703 14484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:16.959751 14487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:16.959713 14485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:16.960040 14445 server_base.cc:1034] running on GCE node
I20260806 15:11:16.960242 14445 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:16.960503 14445 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:16.961663 14445 hybrid_clock.cc:648] HybridClock initialized: now 1786029076961637 us; error 43 us; skew 500 ppm
Aug 06 15:11:16 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029076, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:16.964347 14445 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:11:16.964900 14445 webserver.cc:460] Webserver started at http://127.29.69.129:35189/ using document root <none> and password file <none>
I20260806 15:11:16.965157 14445 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:16.965230 14445 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:16.967015 14445 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:16.967823 14494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:16.968024 14445 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:16.968119 14445 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "53f81a800fdb7e618bb184007b97c985"
server_key_iv: "4d14ec62e601c86ae239e7a359a05dca"
server_key_version: "encryptionkey@0"
I20260806 15:11:16.968539 14445 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:16.996369 14445 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:16.998739 14445 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:16.998888 14445 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:16.999150 14445 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:16.999621 14501 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260806 15:11:17.001634 14445 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260806 15:11:17.001718 14445 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260806 15:11:17.001770 14445 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260806 15:11:17.002521 14445 ts_tablet_manager.cc:610] Registered 1 tablets
I20260806 15:11:17.002578 14445 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:17.002648 14501 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap starting.
I20260806 15:11:17.010260 14445 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:43787
I20260806 15:11:17.010350 14610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:43787 every 8 connection(s)
I20260806 15:11:17.010902 14445 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:17.014747 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14445
I20260806 15:11:17.014819 14501 log.cc:824] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:17.015116 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:37643
--local_ip_for_outbound_sockets=127.29.69.130
--tserver_master_addrs=127.29.69.190:35559
--webserver_port=36623
--webserver_interface=127.29.69.130
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:11:17.017920 14501 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260806 15:11:17.018332 14501 tablet_bootstrap.cc:492] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Bootstrap complete.
I20260806 15:11:17.019632 14501 ts_tablet_manager.cc:1397] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.011s
I20260806 15:11:17.021101 14501 raft_consensus.cc:348] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:17.021432 14501 raft_consensus.cc:729] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb8de98c5f6c4688a39837a6f2fc2dbe, State: Initialized, Role: FOLLOWER
I20260806 15:11:17.021580 14501 consensus_queue.cc:260] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:17.021862 14501 ts_tablet_manager.cc:1428] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260806 15:11:17.062553 14613 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:11:17.012201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:40607)
0806 15:11:17.012398 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.012444 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:17.012926 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:17.062341 (+ 49415us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":119,"threads_started":1}
W20260806 15:11:17.062842 14611 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:35559 (0 consecutive failures): Network error: Failed to ping master at 127.29.69.190:35559: Client connection negotiation failed: client connection to 127.29.69.190:35559: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260806 15:11:17.063244 14613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.063111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:49017)
0806 15:11:17.063166 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.063216 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260806 15:11:17.063599 14613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.063509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:52357)
0806 15:11:17.063554 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.063581 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 15:11:17.063717 14611 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:11:17.101255 14615 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:17.101477 14615 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:17.101504 14615 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:17.102753 14615 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:17.102794 14615 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:17.102820 14615 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:17.104305 14615 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:37643
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=36623
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14615
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:17.104576 14615 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:17.104812 14615 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:11:17.110055 14615 server_base.cc:1034] running on GCE node
W20260806 15:11:17.110037 14621 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:17.110028 14622 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:17.110074 14625 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:17.110590 14615 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:17.110880 14615 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:17.112048 14615 hybrid_clock.cc:648] HybridClock initialized: now 1786029077112036 us; error 32 us; skew 500 ppm
Aug 06 15:11:17 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029077, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:17.114698 14615 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:11:17.115155 14615 webserver.cc:460] Webserver started at http://127.29.69.130:36623/ using document root <none> and password file <none>
I20260806 15:11:17.115393 14615 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:17.115466 14615 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:17.116842 14615 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 15:11:17.117515 14632 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:17.117733 14615 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:11:17.117841 14615 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "03879ab9b54549b69f37b0455d7396b2"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "bb92e33f6947c58db4641e7f990f2d83"
server_key_iv: "95c6b8fca6df07b46fbd5f0adbcf04e5"
server_key_version: "encryptionkey@0"
I20260806 15:11:17.118206 14615 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:17.140250 14615 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:17.142968 14615 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:17.143144 14615 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:17.143406 14615 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:17.143744 14615 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:17.143800 14615 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:17.143843 14615 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:17.143872 14615 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:17.150043 14615 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:37643
I20260806 15:11:17.150099 14748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:37643 every 8 connection(s)
I20260806 15:11:17.150484 14615 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:17.151482 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14615
I20260806 15:11:17.151803 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:36655
--local_ip_for_outbound_sockets=127.29.69.131
--tserver_master_addrs=127.29.69.190:35559
--webserver_port=43419
--webserver_interface=127.29.69.131
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:11:17.152014 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.151184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:42489)
0806 15:11:17.151387 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.151489 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":78,"threads_started":1}
W20260806 15:11:17.152261 14749 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:35559 (0 consecutive failures): Network error: Failed to ping master at 127.29.69.190:35559: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
I20260806 15:11:17.152601 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.152473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:57479)
0806 15:11:17.152523 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.152561 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 15:11:17.152984 14752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.152879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:56209)
0806 15:11:17.152928 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.152957 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 15:11:17.153121 14749 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260806 15:11:17.236369 14753 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:17.236562 14753 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:17.236586 14753 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:17.237741 14753 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:17.237782 14753 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:17.237807 14753 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:17.239189 14753 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:36655
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=43419
--tserver_master_addrs=127.29.69.190:35559
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14753
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:17.239372 14753 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:17.239544 14753 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:17.244616 14759 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:17.244674 14753 server_base.cc:1034] running on GCE node
W20260806 15:11:17.244695 14758 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:17.244616 14761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:17.244948 14753 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:17.245227 14753 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:17.246376 14753 hybrid_clock.cc:648] HybridClock initialized: now 1786029077246345 us; error 57 us; skew 500 ppm
Aug 06 15:11:17 dist-test-slave-tm1g krb5kdc[13289](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029077, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:17.248981 14753 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:11:17.249465 14753 webserver.cc:460] Webserver started at http://127.29.69.131:43419/ using document root <none> and password file <none>
I20260806 15:11:17.249799 14753 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:17.249867 14753 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:17.251390 14753 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:17.252076 14768 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:17.252256 14753 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:17.252368 14753 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "82183b4d301349f9af430a04af7a6011"
format_stamp: "Formatted at 2026-08-06 15:10:35 on dist-test-slave-tm1g"
server_key: "8e938113adc60e833121bf3472e24852"
server_key_iv: "a7f64d9450fac6451fa6bdad67dc6a45"
server_key_version: "encryptionkey@0"
I20260806 15:11:17.252736 14753 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:17.271173 14753 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:17.273643 14753 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:17.273816 14753 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:17.274091 14753 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:17.274482 14753 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:17.274536 14753 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:17.274573 14753 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:17.274600 14753 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:17.280938 14753 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36655
I20260806 15:11:17.280987 14882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36655 every 8 connection(s)
I20260806 15:11:17.281324 14753 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:11:17.282399 14885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.281964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:55229)
0806 15:11:17.282124 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.282195 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":76,"threads_started":1}
W20260806 15:11:17.282786 14883 heartbeater.cc:644] Failed to heartbeat to 127.29.69.190:35559 (0 consecutive failures): Network error: Failed to ping master at 127.29.69.190:35559: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
I20260806 15:11:17.283079 14885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.282978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:53131)
0806 15:11:17.283031 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.283061 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:11:17.283351 14885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:17.283265 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:50371)
0806 15:11:17.283308 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:17.283329 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 15:11:17.283455 14883 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260806 15:11:17.287581 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14753
I20260806 15:11:18.064308 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.064036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:43665)
0806 15:11:18.064187 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:18.064228 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":65,"threads_started":1}
I20260806 15:11:18.153672 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.153458 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:48339)
0806 15:11:18.153578 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:18.153617 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":56,"threads_started":1}
I20260806 15:11:18.283936 14889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.283740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:49007)
0806 15:11:18.283853 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:18.283887 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":57,"threads_started":1}
I20260806 15:11:18.785558 14890 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:18.785689 14890 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:18.786033 14890 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
Aug 06 15:11:18 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029076, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.130@KRBTEST.COM
Aug 06 15:11:18 dist-test-slave-tm1g krb5kdc[13289](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029076, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.131@KRBTEST.COM
I20260806 15:11:18.797647 14893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.786357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:53369 (local address 127.29.69.131:36655)
0806 15:11:18.786494 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:18.786506 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:18.786534 (+ 28us) server_negotiation.cc:407] Connection header received
0806 15:11:18.787016 (+ 482us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:18.787019 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:18.787064 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:18.787181 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:18.788126 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.789000 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.789993 (+ 993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.790462 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.790581 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:18.793422 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:18.793428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:18.793428 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:18.793444 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:18.795430 (+ 1986us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:18.796085 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:18.796088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:18.796088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:18.796221 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:18.796539 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:18.796539 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:18.796540 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:18.796858 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:18.796954 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:18.797384 (+ 430us) server_negotiation.cc:299] Negotiation successful
0806 15:11:18.797527 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":52,"threads_started":1}
I20260806 15:11:18.797647 14894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.786442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:50975 (local address 127.29.69.130:37643)
0806 15:11:18.786579 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:18.786589 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:18.786617 (+ 28us) server_negotiation.cc:407] Connection header received
0806 15:11:18.787399 (+ 782us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:18.787403 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:18.787455 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:18.787596 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:18.788094 (+ 498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.788969 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.789994 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.790461 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.790581 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:18.793013 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:18.793018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:18.793018 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:18.793032 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:18.795443 (+ 2411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:18.796085 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:18.796088 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:18.796088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:18.796221 (+ 133us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:18.796537 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:18.796538 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:18.796539 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:18.796858 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:18.796949 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:18.797384 (+ 435us) server_negotiation.cc:299] Negotiation successful
0806 15:11:18.797527 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":50,"threads_started":1}
I20260806 15:11:18.797659 14891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.786213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36655 (local address 127.29.69.129:53369)
0806 15:11:18.786382 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:18.786394 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:18.786458 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:18.787273 (+ 815us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:18.787277 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:18.787745 (+ 468us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:18.787962 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:18.787968 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.789127 (+ 1159us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.789128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:18.789893 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:18.789896 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.790568 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.790569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:18.790692 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:18.791310 (+ 618us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:18.791319 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:18.793294 (+ 1975us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:18.795532 (+ 2238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:18.795542 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:18.795545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:18.795987 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:18.796302 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:18.796303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:18.796304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:18.796462 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:18.796973 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:18.796984 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:18.797164 (+ 180us) client_negotiation.cc:769] Sending connection context
0806 15:11:18.797312 (+ 148us) client_negotiation.cc:240] Negotiation successful
0806 15:11:18.797538 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":69,"thread_start_us":73,"threads_started":1}
I20260806 15:11:18.798436 14892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:18.786279 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:37643 (local address 127.29.69.129:50975)
0806 15:11:18.786506 (+ 227us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:18.786517 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:18.786577 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:18.787590 (+ 1013us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:18.787591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:18.787777 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:18.787963 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:18.787969 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.789078 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.789080 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:18.789898 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:18.789900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:18.790572 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:18.790573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:18.790692 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:18.791367 (+ 675us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:18.791372 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:18.792886 (+ 1514us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:18.795532 (+ 2646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:18.795542 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:18.795545 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:18.795987 (+ 442us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:18.796302 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:18.796303 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:18.796304 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:18.796462 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:18.796973 (+ 511us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:18.796984 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:18.797165 (+ 181us) client_negotiation.cc:769] Sending connection context
0806 15:11:18.797312 (+ 147us) client_negotiation.cc:240] Negotiation successful
0806 15:11:18.797598 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"mutex_wait_us":177,"thread_start_us":113,"threads_started":1}
W20260806 15:11:18.798627 14497 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
W20260806 15:11:18.799091 14498 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:11:18.799151 14498 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb8de98c5f6c4688a39837a6f2fc2dbe; no voters: 03879ab9b54549b69f37b0455d7396b2, 82183b4d301349f9af430a04af7a6011
I20260806 15:11:18.799276 14890 raft_consensus.cc:2726] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:11:19.064996 14892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:19.064856 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:38233)
0806 15:11:19.064912 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:19.064953 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 15:11:19.154349 14895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:19.154084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:44703)
0806 15:11:19.154220 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:19.154262 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":66,"threads_started":1}
I20260806 15:11:19.284655 14896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:19.284425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:37245)
0806 15:11:19.284568 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:19.284612 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260806 15:11:20.065727 14897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:20.065481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:55377)
0806 15:11:20.065639 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:20.065676 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":78,"threads_started":1}
I20260806 15:11:20.154976 14898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:20.154782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:56617)
0806 15:11:20.154897 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:20.154931 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260806 15:11:20.285315 14899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:20.285115 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:53243)
0806 15:11:20.285236 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:20.285274 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260806 15:11:21.023797 14900 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:21.023904 14900 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:21.024129 14900 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
W20260806 15:11:21.024662 14497 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
W20260806 15:11:21.024725 14498 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:11:21.024755 14497 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb8de98c5f6c4688a39837a6f2fc2dbe; no voters: 03879ab9b54549b69f37b0455d7396b2, 82183b4d301349f9af430a04af7a6011
I20260806 15:11:21.024833 14900 raft_consensus.cc:2726] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:11:21.066490 14901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:21.066211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:52487)
0806 15:11:21.066391 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:21.066425 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":64,"threads_started":1}
I20260806 15:11:21.155584 14902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:21.155363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:33379)
0806 15:11:21.155496 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:21.155533 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":59,"threads_started":1}
I20260806 15:11:21.285996 14903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:21.285771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:57525)
0806 15:11:21.285906 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:21.285943 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":62,"threads_started":1}
I20260806 15:11:22.067217 14904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:22.066979 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:42351)
0806 15:11:22.067131 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:22.067167 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":73,"threads_started":1}
I20260806 15:11:22.156265 14905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:22.156060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:45803)
0806 15:11:22.156184 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:22.156220 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260806 15:11:22.286680 14906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:22.286498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:44025)
0806 15:11:22.286609 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:22.286641 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":55,"threads_started":1}
I20260806 15:11:23.067991 14907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:23.067747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:60847)
0806 15:11:23.067897 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:23.067939 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":69,"threads_started":1}
I20260806 15:11:23.156927 14908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:23.156704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:50847)
0806 15:11:23.156840 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:23.156877 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":77,"threads_started":1}
I20260806 15:11:23.287330 14909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:23.287111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:47171)
0806 15:11:23.287249 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:23.287287 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260806 15:11:24.068725 14910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:24.068472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:49845)
0806 15:11:24.068635 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:24.068673 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":81,"threads_started":1}
I20260806 15:11:24.157584 14911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:24.157352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:43649)
0806 15:11:24.157507 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:24.157544 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":76,"threads_started":1}
I20260806 15:11:24.260489 14912 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:24.260582 14912 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:24.260761 14912 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
W20260806 15:11:24.261137 14497 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
W20260806 15:11:24.261219 14498 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:11:24.261284 14498 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb8de98c5f6c4688a39837a6f2fc2dbe; no voters: 03879ab9b54549b69f37b0455d7396b2, 82183b4d301349f9af430a04af7a6011
I20260806 15:11:24.261377 14912 raft_consensus.cc:2726] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:11:24.288059 14913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:24.287844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:44039)
0806 15:11:24.287982 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:24.288018 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260806 15:11:25.069626 14914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:25.069368 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:52333)
0806 15:11:25.069530 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:25.069571 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":113,"threads_started":1}
I20260806 15:11:25.158375 14915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:25.158073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:47407)
0806 15:11:25.158226 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:25.158266 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":65,"threads_started":1}
I20260806 15:11:25.288769 14916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:25.288512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:59865)
0806 15:11:25.288676 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:25.288726 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":75,"threads_started":1}
I20260806 15:11:26.070384 14917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:26.070067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:35941)
0806 15:11:26.070229 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:26.070271 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":67,"threads_started":1}
I20260806 15:11:26.159041 14918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:26.158819 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:60947)
0806 15:11:26.158950 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:26.158983 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260806 15:11:26.289484 14919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:26.289236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:56769)
0806 15:11:26.289403 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:26.289442 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":76,"threads_started":1}
I20260806 15:11:26.311012 14920 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:26.311133 14920 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:26.311331 14920 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
W20260806 15:11:26.311717 14497 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
W20260806 15:11:26.311789 14498 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:11:26.311818 14497 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb8de98c5f6c4688a39837a6f2fc2dbe; no voters: 03879ab9b54549b69f37b0455d7396b2, 82183b4d301349f9af430a04af7a6011
I20260806 15:11:26.311913 14920 raft_consensus.cc:2726] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:11:27.071100 14921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:27.070880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:56221)
0806 15:11:27.071020 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:27.071052 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
I20260806 15:11:27.159724 14922 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:27.159507 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:36219)
0806 15:11:27.159647 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:27.159682 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":76,"threads_started":1}
I20260806 15:11:27.290227 14923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:27.290010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:36471)
0806 15:11:27.290150 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:27.290185 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":62,"threads_started":1}
I20260806 15:11:28.071808 14924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:28.071560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:56229)
0806 15:11:28.071710 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:28.071749 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
I20260806 15:11:28.160487 14925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:28.160239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:38795)
0806 15:11:28.160387 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:28.160431 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":61,"threads_started":1}
I20260806 15:11:28.290881 14926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:28.290654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:34977)
0806 15:11:28.290791 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:28.290828 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":64,"threads_started":1}
I20260806 15:11:28.428752 14927 raft_consensus.cc:482] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:28.428851 14927 raft_consensus.cc:504] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82183b4d301349f9af430a04af7a6011" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36655 } } peers { permanent_uuid: "03879ab9b54549b69f37b0455d7396b2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 37643 } } peers { permanent_uuid: "fb8de98c5f6c4688a39837a6f2fc2dbe" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 43787 } }
I20260806 15:11:28.429076 14927 leader_election.cc:288] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655), 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643)
W20260806 15:11:28.429466 14498 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 03879ab9b54549b69f37b0455d7396b2 (127.29.69.130:37643): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
W20260806 15:11:28.429559 14497 leader_election.cc:341] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 82183b4d301349f9af430a04af7a6011 (127.29.69.131:36655): Not found: Tablet not found: 9bfe2e2edfc34bd7a4dd980fbd978dea
I20260806 15:11:28.429666 14497 leader_election.cc:302] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fb8de98c5f6c4688a39837a6f2fc2dbe; no voters: 03879ab9b54549b69f37b0455d7396b2, 82183b4d301349f9af430a04af7a6011
I20260806 15:11:28.429744 14927 raft_consensus.cc:2726] T 9bfe2e2edfc34bd7a4dd980fbd978dea P fb8de98c5f6c4688a39837a6f2fc2dbe [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260806 15:11:29.072542 14928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:29.072326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:57729)
0806 15:11:29.072453 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:29.072492 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260806 15:11:29.161160 14929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:29.160931 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:33027)
0806 15:11:29.161076 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:29.161112 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260806 15:11:29.291581 14930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:29.291324 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:34881)
0806 15:11:29.291487 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:29.291533 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":68,"threads_started":1}
I20260806 15:11:30.073383 14931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:30.073145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:48971)
0806 15:11:30.073291 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:30.073335 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260806 15:11:30.161935 14932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:30.161675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:35431)
0806 15:11:30.161835 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:30.161881 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":78,"threads_started":1}
I20260806 15:11:30.292243 14933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:30.292035 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:59189)
0806 15:11:30.292163 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:30.292199 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":59,"threads_started":1}
I20260806 15:11:31.074069 14934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:31.073802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:40385)
0806 15:11:31.073950 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:31.074004 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":103,"threads_started":1}
I20260806 15:11:31.162618 14935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:31.162413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:52281)
0806 15:11:31.162540 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:31.162571 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
I20260806 15:11:31.292990 14936 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:31.292763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:58195)
0806 15:11:31.292912 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:31.292947 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
I20260806 15:11:32.074812 14937 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:32.074601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.129:49709)
0806 15:11:32.074730 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:32.074765 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260806 15:11:32.163368 14938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:32.163136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.130:42315)
0806 15:11:32.163285 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:32.163324 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260806 15:11:32.292604 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 14445
I20260806 15:11:32.295115 14939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:32.294904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:35559 (local address 127.29.69.131:59753)
0806 15:11:32.295031 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:32.295070 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.190:35559: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
I20260806 15:11:32.298434 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 14615
I20260806 15:11:32.303679 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 14753
2026-08-06T15:11:32Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58285 ms)
[----------] 30 tests from SecurityITest (234686 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:32 dist-test-slave-tm1g krb5kdc[14942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:32 dist-test-slave-tm1g krb5kdc[14942](info): set up 2 sockets
Aug 06 15:11:32 dist-test-slave-tm1g krb5kdc[14942](info): commencing operation
krb5kdc: starting...
W20260806 15:11:33.367890 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:11:33.486114 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36789
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:37815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:36789
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:33.566181 14955 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:33.566473 14955 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:33.566512 14955 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:33.567651 14955 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:33.567718 14955 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:33.567739 14955 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:33.567762 14955 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:33.567790 14955 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:33.569258 14955 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:37815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:36789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14955
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:33.569530 14955 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:33.569754 14955 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:33.574750 14960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:33.574762 14961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:33.574957 14955 server_base.cc:1034] running on GCE node
W20260806 15:11:33.574769 14963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:33.575306 14955 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:33.575613 14955 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:33.576782 14955 hybrid_clock.cc:648] HybridClock initialized: now 1786029093576767 us; error 26 us; skew 500 ppm
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:33.579329 14955 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:11:33.579766 14955 webserver.cc:460] Webserver started at http://127.29.69.190:37441/ using document root <none> and password file <none>
I20260806 15:11:33.580052 14955 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:33.580125 14955 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:33.580262 14955 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:33.581405 14955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "6ca2c9badb4b402092c5c792c442f5d7"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "3e3a04349b0e6443b0e08bddfcdaa932"
server_key_iv: "ae47fb205b47003b0dc5ae959f4c32fa"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.581777 14955 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "6ca2c9badb4b402092c5c792c442f5d7"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "3e3a04349b0e6443b0e08bddfcdaa932"
server_key_iv: "ae47fb205b47003b0dc5ae959f4c32fa"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.583209 14955 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:33.583945 14970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.584126 14955 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:33.584236 14955 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "6ca2c9badb4b402092c5c792c442f5d7"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "3e3a04349b0e6443b0e08bddfcdaa932"
server_key_iv: "ae47fb205b47003b0dc5ae959f4c32fa"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.584321 14955 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:33.606624 14955 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:33.608503 14955 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:33.608675 14955 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:33.612775 14955 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:36789
I20260806 15:11:33.612814 15023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:36789 every 8 connection(s)
I20260806 15:11:33.613181 14955 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:33.614048 15024 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:33.616324 15024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7: Bootstrap starting.
I20260806 15:11:33.616927 15024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:33.617220 15024 log.cc:824] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:33.617940 15024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7: No bootstrap required, opened a new log
I20260806 15:11:33.619551 15024 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca2c9badb4b402092c5c792c442f5d7" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36789 } }
I20260806 15:11:33.619689 15024 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:33.619712 15024 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ca2c9badb4b402092c5c792c442f5d7, State: Initialized, Role: FOLLOWER
I20260806 15:11:33.619899 15024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca2c9badb4b402092c5c792c442f5d7" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36789 } }
I20260806 15:11:33.619967 15024 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:33.619990 15024 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:33.620060 15024 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:33.620671 15024 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca2c9badb4b402092c5c792c442f5d7" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36789 } }
I20260806 15:11:33.620702 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 14955
I20260806 15:11:33.620788 15024 leader_election.cc:302] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6ca2c9badb4b402092c5c792c442f5d7; no voters:
I20260806 15:11:33.620822 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:33.621021 29974 external_mini_cluster.cc:1428] Setting key 14102e1eb1244e699acaa1f7d6f08318
I20260806 15:11:33.621018 15024 leader_election.cc:288] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:33.621043 15027 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:33.621158 15027 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [term 1 LEADER]: Becoming Leader. State: Replica: 6ca2c9badb4b402092c5c792c442f5d7, State: Running, Role: LEADER
I20260806 15:11:33.621297 15024 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:33.621296 15027 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca2c9badb4b402092c5c792c442f5d7" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36789 } }
I20260806 15:11:33.621829 15028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6ca2c9badb4b402092c5c792c442f5d7. Latest consensus state: current_term: 1 leader_uuid: "6ca2c9badb4b402092c5c792c442f5d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca2c9badb4b402092c5c792c442f5d7" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36789 } } }
I20260806 15:11:33.621924 15028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:33.621968 15029 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6ca2c9badb4b402092c5c792c442f5d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6ca2c9badb4b402092c5c792c442f5d7" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36789 } } }
I20260806 15:11:33.622053 15029 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:33.622249 15037 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:33.622891 15037 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:33.624622 15037 catalog_manager.cc:1347] Generated new cluster ID: 2cdb58ada19e4ae78983e32074f5f302
I20260806 15:11:33.624679 15037 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:33.633698 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:33.621636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37896 (local address 127.29.69.190:36789)
0806 15:11:33.621846 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:33.621856 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:33.621896 (+ 40us) server_negotiation.cc:407] Connection header received
0806 15:11:33.622026 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:33.622033 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:33.622095 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:33.623167 (+ 1072us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:33.623266 (+ 99us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.624545 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.625726 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.626360 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.626466 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:33.629361 (+ 2895us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:33.629364 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:33.629365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:33.629375 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:33.632032 (+ 2657us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:33.632453 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:33.632456 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:33.632456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:33.632571 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:33.632788 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:33.632788 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:33.632789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:33.633083 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:33.633226 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:33.633351 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 15:11:33.633480 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":99,"threads_started":1}
I20260806 15:11:33.640643 15037 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:33.641345 15037 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:33.651957 15037 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7: Generated new TSK 0
I20260806 15:11:33.652160 15037 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:11:33.678864 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36789
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:37815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:33.764034 15050 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:33.764263 15050 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:33.764304 15050 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:33.765501 15050 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:33.765568 15050 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:33.765614 15050 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:33.767184 15050 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:37815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15050
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:33.767468 15050 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:33.767709 15050 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:33.772794 15055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:33.772804 15056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:33.772792 15058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:33.773138 15050 server_base.cc:1034] running on GCE node
I20260806 15:11:33.773401 15050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:33.773602 15050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:33.774739 15050 hybrid_clock.cc:648] HybridClock initialized: now 1786029093774721 us; error 36 us; skew 500 ppm
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:33.777160 15050 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:11:33.777588 15050 webserver.cc:460] Webserver started at http://127.29.69.129:32863/ using document root <none> and password file <none>
I20260806 15:11:33.777829 15050 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:33.777874 15050 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:33.778044 15050 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:33.779161 15050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "876e9a3062054553ab535e6981d37bd2"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "d768c500f7fb9f97bb7a88c13dc90f45"
server_key_iv: "f9d91d9991979d87f7cf8dd9f65e78ff"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.779520 15050 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "876e9a3062054553ab535e6981d37bd2"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "d768c500f7fb9f97bb7a88c13dc90f45"
server_key_iv: "f9d91d9991979d87f7cf8dd9f65e78ff"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.780864 15050 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:33.781623 15065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.781806 15050 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:33.781916 15050 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "876e9a3062054553ab535e6981d37bd2"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "d768c500f7fb9f97bb7a88c13dc90f45"
server_key_iv: "f9d91d9991979d87f7cf8dd9f65e78ff"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.781994 15050 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:33.791847 15050 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:33.793749 15050 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:33.793910 15050 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:33.794133 15050 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:33.794550 15050 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:33.794607 15050 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.794641 15050 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:33.794673 15050 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.800390 15050 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:42329
I20260806 15:11:33.800442 15179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:42329 every 8 connection(s)
I20260806 15:11:33.800750 15050 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:33.803856 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15050
I20260806 15:11:33.803966 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:11:33.804168 29974 external_mini_cluster.cc:1428] Setting key fd42ef2addd1b5bd9150a2eb17e3256f
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:33.811023 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:33.801472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:60965 (local address 127.29.69.190:36789)
0806 15:11:33.801537 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:33.801540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:33.801707 (+ 167us) server_negotiation.cc:407] Connection header received
0806 15:11:33.802201 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:33.802202 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:33.802211 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:33.802267 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:33.803230 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.803740 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.805200 (+ 1460us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.805410 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.805469 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:33.807766 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:33.807768 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:33.807768 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:33.807777 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:33.809492 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:33.810003 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:33.810003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:33.810004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:33.810055 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:33.810362 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:33.810363 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:33.810363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:33.810477 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:33.810530 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:33.810885 (+ 355us) server_negotiation.cc:299] Negotiation successful
0806 15:11:33.810959 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 15:11:33.811277 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:33.801399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36789 (local address 127.29.69.129:60965)
0806 15:11:33.801579 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:33.801620 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:33.802117 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:33.802337 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:33.802340 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:33.802935 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:33.803134 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:33.803139 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.803841 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.803842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:33.805112 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:33.805115 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.805498 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.805499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:33.805664 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:33.806160 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:33.806170 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:33.807669 (+ 1499us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:33.809576 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:33.809584 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:33.809587 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:33.809922 (+ 335us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:33.810124 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:33.810125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:33.810125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:33.810272 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:33.810549 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:33.810558 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:33.810734 (+ 176us) client_negotiation.cc:769] Sending connection context
0806 15:11:33.810852 (+ 118us) client_negotiation.cc:240] Negotiation successful
0806 15:11:33.811030 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
I20260806 15:11:33.811862 15180 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36789
I20260806 15:11:33.811973 15180 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:33.812183 15180 heartbeater.cc:511] Master 127.29.69.190:36789 requested a full tablet report, sending...
I20260806 15:11:33.812682 14987 ts_manager.cc:194] Registered new tserver with Master: 876e9a3062054553ab535e6981d37bd2 (127.29.69.129:42329)
I20260806 15:11:33.813309 14987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:60965
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:11:33.831037 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36789
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:37815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:33.913897 15185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:33.914111 15185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:33.914149 15185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:33.915897 15185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:33.915958 15185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:33.916004 15185 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:33.917760 15185 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:37815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:33.918032 15185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:33.918360 15185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:33.924539 15193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:33.924661 15185 server_base.cc:1034] running on GCE node
W20260806 15:11:33.924662 15190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:33.924499 15191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:33.925016 15185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:33.925310 15185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:33.926476 15185 hybrid_clock.cc:648] HybridClock initialized: now 1786029093926452 us; error 41 us; skew 500 ppm
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:33.929260 15185 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:11:33.929682 15185 webserver.cc:460] Webserver started at http://127.29.69.130:42817/ using document root <none> and password file <none>
I20260806 15:11:33.929934 15185 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:33.930011 15185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:33.930167 15185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:33.931277 15185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "3dac9f6e1184464d8d634f97d186ad52"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "9cb3ef6d7f5e67c9d305cabfef0799e9"
server_key_iv: "d9d480a27e319edeaf89af54e9de639b"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.931641 15185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "3dac9f6e1184464d8d634f97d186ad52"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "9cb3ef6d7f5e67c9d305cabfef0799e9"
server_key_iv: "d9d480a27e319edeaf89af54e9de639b"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.932971 15185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:11:33.933669 15200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.933833 15185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:33.933931 15185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "3dac9f6e1184464d8d634f97d186ad52"
format_stamp: "Formatted at 2026-08-06 15:11:33 on dist-test-slave-tm1g"
server_key: "9cb3ef6d7f5e67c9d305cabfef0799e9"
server_key_iv: "d9d480a27e319edeaf89af54e9de639b"
server_key_version: "encryptionkey@0"
I20260806 15:11:33.934026 15185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:33.954435 15185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:33.956984 15185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:33.957150 15185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:33.957396 15185 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:33.957720 15185 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:33.957773 15185 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.957818 15185 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:33.957851 15185 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:33.963796 15185 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:33511
I20260806 15:11:33.963878 15314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:33511 every 8 connection(s)
I20260806 15:11:33.964186 15185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:33.965864 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15185
I20260806 15:11:33.966003 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:11:33.966248 29974 external_mini_cluster.cc:1428] Setting key b699c54755744de3f92fe095c52db3c3
Aug 06 15:11:33 dist-test-slave-tm1g krb5kdc[14942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029093, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:33.974144 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:33.964913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:41815 (local address 127.29.69.190:36789)
0806 15:11:33.964966 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:33.964968 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:33.965168 (+ 200us) server_negotiation.cc:407] Connection header received
0806 15:11:33.965657 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:33.965658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:33.965668 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:33.965741 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:33.966956 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.967471 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.968471 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.968688 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.968765 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:33.971319 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:33.971320 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:33.971321 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:33.971327 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:33.972702 (+ 1375us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:33.973184 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:33.973185 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:33.973185 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:33.973234 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:33.973525 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:33.973526 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:33.973526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:33.973626 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:33.973674 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:33.974014 (+ 340us) server_negotiation.cc:299] Negotiation successful
0806 15:11:33.974081 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:11:33.974462 15317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:33.964870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36789 (local address 127.29.69.130:41815)
0806 15:11:33.965035 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:33.965077 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:33.965574 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:33.965819 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:33.965823 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:33.966597 (+ 774us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:33.966810 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:33.966816 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.967576 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.967580 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:33.968381 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:33.968383 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:33.968770 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:33.968771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:33.968908 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:33.969462 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:33.969470 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:33.971219 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:33.972790 (+ 1571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:33.972798 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:33.972801 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:33.973105 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:33.973299 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:33.973299 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:33.973300 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:33.973446 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:33.973693 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:33.973700 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:33.973869 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 15:11:33.973998 (+ 129us) client_negotiation.cc:240] Negotiation successful
0806 15:11:33.974171 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":97,"threads_started":1}
I20260806 15:11:33.975008 15315 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36789
I20260806 15:11:33.975107 15315 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
I20260806 15:11:33.975317 15315 heartbeater.cc:511] Master 127.29.69.190:36789 requested a full tablet report, sending...
I20260806 15:11:33.975694 14987 ts_manager.cc:194] Registered new tserver with Master: 3dac9f6e1184464d8d634f97d186ad52 (127.29.69.130:33511)
I20260806 15:11:33.976071 14987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:41815
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:11:33.991384 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36789
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:37815
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:34.072921 15320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:34.073117 15320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:34.073140 15320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:34.074189 15320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:34.074223 15320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:34.074249 15320 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:34.075685 15320 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:37815
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:36789
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15320
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:34.075886 15320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:34.076064 15320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:34.081342 15326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.081346 15325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.081342 15320 server_base.cc:1034] running on GCE node
W20260806 15:11:34.081372 15328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.081727 15320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:34.081974 15320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:34.083135 15320 hybrid_clock.cc:648] HybridClock initialized: now 1786029094083132 us; error 36 us; skew 500 ppm
Aug 06 15:11:34 dist-test-slave-tm1g krb5kdc[14942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029094, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:34.085796 15320 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:11:34.086171 15320 webserver.cc:460] Webserver started at http://127.29.69.131:35375/ using document root <none> and password file <none>
I20260806 15:11:34.086428 15320 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:34.086476 15320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:34.086568 15320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:34.087642 15320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "3ef03187464842b58490b94757eaa020"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "da6093ca34fec6c3375d32ff5af2c710"
server_key_iv: "817d1b77ba65fae18425a8d8033d52d5"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.087992 15320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "3ef03187464842b58490b94757eaa020"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "da6093ca34fec6c3375d32ff5af2c710"
server_key_iv: "817d1b77ba65fae18425a8d8033d52d5"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.089272 15320 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:34.089952 15335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.090128 15320 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:34.090248 15320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "3ef03187464842b58490b94757eaa020"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "da6093ca34fec6c3375d32ff5af2c710"
server_key_iv: "817d1b77ba65fae18425a8d8033d52d5"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.090344 15320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:34.108016 15320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:34.110278 15320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:34.110419 15320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:34.110612 15320 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:34.110858 15320 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:34.110889 15320 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.110911 15320 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:34.110924 15320 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.116710 15320 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:38773
I20260806 15:11:34.116773 15451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:38773 every 8 connection(s)
I20260806 15:11:34.117084 15320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
Aug 06 15:11:34 dist-test-slave-tm1g krb5kdc[14942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029094, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:34.126051 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15320
I20260806 15:11:34.126169 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:11:34.126269 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.117815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:35217 (local address 127.29.69.190:36789)
0806 15:11:34.117891 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.117893 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.118047 (+ 154us) server_negotiation.cc:407] Connection header received
0806 15:11:34.118588 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.118589 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.118599 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.118656 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.119523 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.120013 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.121061 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.121316 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.121379 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.123672 (+ 2293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.123674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.123674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:34.123680 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.125004 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:34.125401 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:34.125402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:34.125402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:34.125452 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:34.125665 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:34.125666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:34.125666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:34.125765 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.125814 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.126066 (+ 252us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.126165 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260806 15:11:34.126396 29974 external_mini_cluster.cc:1428] Setting key f04ab9e01ed4ece91d7718d570d8ed3a
I20260806 15:11:34.126432 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.117766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:36789 (local address 127.29.69.131:35217)
0806 15:11:34.117925 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.117968 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.118503 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.118706 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.118709 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.119260 (+ 551us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:34.119446 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.119450 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.120091 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.120092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.120960 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.120963 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.121394 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.121395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.121496 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.121998 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:34.122006 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:34.123566 (+ 1560us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:34.125100 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:34.125107 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:34.125109 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:34.125321 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:34.125510 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:34.125510 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:34.125510 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:34.125609 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:34.125819 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:34.125823 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:34.125932 (+ 109us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.126019 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.126182 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":87,"threads_started":1}
I20260806 15:11:34.126914 15452 heartbeater.cc:347] Connected to a master server at 127.29.69.190:36789
I20260806 15:11:34.127044 15452 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:34.127224 15452 heartbeater.cc:511] Master 127.29.69.190:36789 requested a full tablet report, sending...
I20260806 15:11:34.127609 14987 ts_manager.cc:194] Registered new tserver with Master: 3ef03187464842b58490b94757eaa020 (127.29.69.131:38773)
I20260806 15:11:34.127993 14987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:35217
I20260806 15:11:34.138592 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:11:34.145323 15032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.139924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37898 (local address 127.29.69.190:36789)
0806 15:11:34.140001 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.140003 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.140060 (+ 57us) server_negotiation.cc:407] Connection header received
0806 15:11:34.140100 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.140101 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.140109 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.140154 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.140679 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.141144 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.141810 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.141991 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.142038 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.143238 (+ 1200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.143240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.143240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:34.143245 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.144385 (+ 1140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:34.144688 (+ 303us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:34.144689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:34.144689 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:34.144735 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:34.144892 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:34.144892 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:34.144892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:34.145027 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.145100 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.145183 (+ 83us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.145238 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:11:34.146983 14987 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:11:34.148553 14987 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:11:34.154893 15460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.150727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:33511 (local address 127.0.0.1:40954)
0806 15:11:34.151252 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.151263 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.151307 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.151581 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.151584 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.151587 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.151651 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.151653 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.152627 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.152628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.153764 (+ 1136us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.153767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.154591 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.154592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.154675 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.154688 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.154762 (+ 74us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.154814 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":3,"thread_start_us":60,"threads_started":1}
I20260806 15:11:34.154925 15462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.150858 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40954 (local address 127.29.69.130:33511)
0806 15:11:34.151313 (+ 455us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.151318 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.151329 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:11:34.151372 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.151374 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.151394 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.151464 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.151733 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.152519 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.153857 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.154507 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.154581 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.154635 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.154791 (+ 156us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.154834 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":118,"threads_started":1}
I20260806 15:11:34.155212 15463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.150727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38773 (local address 127.0.0.1:40218)
0806 15:11:34.151046 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.151087 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.151153 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.151600 (+ 447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.151601 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.151604 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.151657 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.151659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.153073 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.153074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.154051 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.154053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.154986 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.154988 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.155067 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.155071 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.155101 (+ 30us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.155144 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":291,"thread_start_us":64,"threads_started":1}
I20260806 15:11:34.155560 15465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.151070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40218 (local address 127.29.69.131:38773)
0806 15:11:34.151290 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.151294 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.151304 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:11:34.151345 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.151346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.151358 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.151462 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.151759 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.152939 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.154128 (+ 1189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.154881 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.155334 (+ 453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.155402 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.155428 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.155481 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":97,"threads_started":1}
I20260806 15:11:34.156003 15248 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3af1e53b53415782375bbfe25b7048 (DEFAULT_TABLE table=test-table [id=b8c4d25d4ab940a99a766009c78cf844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:34.156387 15461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.150926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:42329 (local address 127.0.0.1:52182)
0806 15:11:34.151373 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.151381 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.151424 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.151708 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.151709 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.151711 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.151767 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.151769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.154120 (+ 2351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.154121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.155062 (+ 941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.155066 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.156134 (+ 1068us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.156135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.156209 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.156214 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.156270 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.156311 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439,"thread_start_us":74,"threads_started":1}
I20260806 15:11:34.156399 15248 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3af1e53b53415782375bbfe25b7048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.156636 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.151067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52182 (local address 127.29.69.129:42329)
0806 15:11:34.151242 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.151248 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.151491 (+ 243us) server_negotiation.cc:407] Connection header received
0806 15:11:34.151539 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.151541 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.151558 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.151626 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.151855 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.152939 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.155139 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.156049 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.156114 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.156149 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.156512 (+ 363us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.156561 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":101,"threads_started":1}
I20260806 15:11:34.157310 15113 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3af1e53b53415782375bbfe25b7048 (DEFAULT_TABLE table=test-table [id=b8c4d25d4ab940a99a766009c78cf844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:34.157660 15113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3af1e53b53415782375bbfe25b7048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.159175 15385 tablet_service.cc:1467] Processing CreateTablet for tablet 2e3af1e53b53415782375bbfe25b7048 (DEFAULT_TABLE table=test-table [id=b8c4d25d4ab940a99a766009c78cf844]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:34.159512 15385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e3af1e53b53415782375bbfe25b7048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.161042 15466 tablet_bootstrap.cc:492] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2: Bootstrap starting.
I20260806 15:11:34.161660 15466 tablet_bootstrap.cc:654] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.162374 15466 log.cc:824] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.162613 15468 tablet_bootstrap.cc:492] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Bootstrap starting.
I20260806 15:11:34.163110 15466 tablet_bootstrap.cc:492] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2: No bootstrap required, opened a new log
I20260806 15:11:34.163196 15466 ts_tablet_manager.cc:1397] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:34.163336 15468 tablet_bootstrap.cc:654] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.163933 15468 log.cc:824] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.164242 15470 tablet_bootstrap.cc:492] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Bootstrap starting.
I20260806 15:11:34.164721 15470 tablet_bootstrap.cc:654] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.164891 15466 raft_consensus.cc:348] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.165066 15466 raft_consensus.cc:374] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.165117 15466 raft_consensus.cc:729] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 876e9a3062054553ab535e6981d37bd2, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.165194 15470 log.cc:824] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.165234 15466 consensus_queue.cc:260] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.165565 15466 ts_tablet_manager.cc:1428] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:34.165928 15470 tablet_bootstrap.cc:492] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: No bootstrap required, opened a new log
I20260806 15:11:34.165937 15468 tablet_bootstrap.cc:492] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: No bootstrap required, opened a new log
I20260806 15:11:34.166003 15470 ts_tablet_manager.cc:1397] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:34.166010 15468 ts_tablet_manager.cc:1397] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:11:34.166379 15180 heartbeater.cc:503] Master 127.29.69.190:36789 was elected leader, sending a full tablet report...
I20260806 15:11:34.168023 15470 raft_consensus.cc:348] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.168197 15470 raft_consensus.cc:374] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.168239 15470 raft_consensus.cc:729] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dac9f6e1184464d8d634f97d186ad52, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.168357 15470 consensus_queue.cc:260] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.168519 15468 raft_consensus.cc:348] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.168653 15470 ts_tablet_manager.cc:1428] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:34.168691 15468 raft_consensus.cc:374] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.168669 15315 heartbeater.cc:503] Master 127.29.69.190:36789 was elected leader, sending a full tablet report...
I20260806 15:11:34.168774 15468 raft_consensus.cc:729] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ef03187464842b58490b94757eaa020, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.168923 15468 consensus_queue.cc:260] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.169214 15468 ts_tablet_manager.cc:1428] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:34.169235 15452 heartbeater.cc:503] Master 127.29.69.190:36789 was elected leader, sending a full tablet report...
I20260806 15:11:34.176159 15475 raft_consensus.cc:482] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:34.176234 15475 raft_consensus.cc:504] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.176555 15475 leader_election.cc:288] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3dac9f6e1184464d8d634f97d186ad52 (127.29.69.130:33511), 876e9a3062054553ab535e6981d37bd2 (127.29.69.129:42329)
I20260806 15:11:34.179565 15462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.176790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:34071 (local address 127.29.69.130:33511)
0806 15:11:34.176829 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.176831 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.176839 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:11:34.176886 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.176887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.176896 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.176963 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.177122 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.177656 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.178804 (+ 1148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.179227 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.179282 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.179289 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.179459 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.179495 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:11:34.179559 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.176705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:33511 (local address 127.29.69.131:34071)
0806 15:11:34.176762 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.176775 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.176823 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.176969 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.176970 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.176972 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.177028 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.177030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.177731 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.177732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.178721 (+ 989us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.178724 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.179304 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.179305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.179386 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.179390 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.179444 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.179499 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 15:11:34.179741 15464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.176870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:47581 (local address 127.29.69.129:42329)
0806 15:11:34.176934 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.176936 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.177061 (+ 125us) server_negotiation.cc:407] Connection header received
0806 15:11:34.177087 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.177088 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.177098 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.177161 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.177290 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.177765 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.178941 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.179356 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.179432 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.179441 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.179625 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.179673 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:11:34.179745 15476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.176800 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:42329 (local address 127.29.69.131:47581)
0806 15:11:34.176991 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.177000 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.177052 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.177166 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.177167 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.177168 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.177231 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.177232 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.177842 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.177843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.178860 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.178862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.179465 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.179466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.179543 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.179548 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.179607 (+ 59us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.179649 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":80,"threads_started":1}
I20260806 15:11:34.179888 15269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3af1e53b53415782375bbfe25b7048" candidate_uuid: "3ef03187464842b58490b94757eaa020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dac9f6e1184464d8d634f97d186ad52" is_pre_election: true
I20260806 15:11:34.180009 15269 raft_consensus.cc:2454] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef03187464842b58490b94757eaa020 in term 0.
I20260806 15:11:34.180032 15133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3af1e53b53415782375bbfe25b7048" candidate_uuid: "3ef03187464842b58490b94757eaa020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876e9a3062054553ab535e6981d37bd2" is_pre_election: true
I20260806 15:11:34.180162 15133 raft_consensus.cc:2454] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ef03187464842b58490b94757eaa020 in term 0.
I20260806 15:11:34.180218 15339 leader_election.cc:302] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dac9f6e1184464d8d634f97d186ad52, 3ef03187464842b58490b94757eaa020; no voters:
I20260806 15:11:34.180331 15475 raft_consensus.cc:2781] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:11:34.180416 15475 raft_consensus.cc:482] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:11:34.180461 15475 raft_consensus.cc:3037] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.181115 15475 raft_consensus.cc:504] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.181248 15475 leader_election.cc:288] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [CANDIDATE]: Term 1 election: Requested vote from peers 3dac9f6e1184464d8d634f97d186ad52 (127.29.69.130:33511), 876e9a3062054553ab535e6981d37bd2 (127.29.69.129:42329)
I20260806 15:11:34.181429 15269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3af1e53b53415782375bbfe25b7048" candidate_uuid: "3ef03187464842b58490b94757eaa020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3dac9f6e1184464d8d634f97d186ad52"
I20260806 15:11:34.181527 15269 raft_consensus.cc:3037] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.181506 15133 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e3af1e53b53415782375bbfe25b7048" candidate_uuid: "3ef03187464842b58490b94757eaa020" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "876e9a3062054553ab535e6981d37bd2"
I20260806 15:11:34.181598 15133 raft_consensus.cc:3037] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.182196 15269 raft_consensus.cc:2454] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef03187464842b58490b94757eaa020 in term 1.
I20260806 15:11:34.182403 15133 raft_consensus.cc:2454] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ef03187464842b58490b94757eaa020 in term 1.
I20260806 15:11:34.182487 15339 leader_election.cc:302] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3dac9f6e1184464d8d634f97d186ad52, 3ef03187464842b58490b94757eaa020; no voters:
I20260806 15:11:34.182607 15475 raft_consensus.cc:2781] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:34.182799 15475 raft_consensus.cc:686] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 1 LEADER]: Becoming Leader. State: Replica: 3ef03187464842b58490b94757eaa020, State: Running, Role: LEADER
I20260806 15:11:34.182902 15475 consensus_queue.cc:237] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } }
I20260806 15:11:34.183653 14986 catalog_manager.cc:5495] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ef03187464842b58490b94757eaa020 (127.29.69.131). New cstate: current_term: 1 leader_uuid: "3ef03187464842b58490b94757eaa020" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3ef03187464842b58490b94757eaa020" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38773 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 } health_report { overall_health: UNKNOWN } } }
I20260806 15:11:34.190065 15465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.187747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40234 (local address 127.29.69.131:38773)
0806 15:11:34.187796 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.187798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.187807 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:34.187838 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.187839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.187863 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.187932 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:11:34.188091 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.188536 (+ 445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.189290 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.189490 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.189564 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.189745 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:11:34.189838 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:11:34.189920 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.189971 (+ 51us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.189991 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260806 15:11:34.191742 15133 raft_consensus.cc:1261] T 2e3af1e53b53415782375bbfe25b7048 P 876e9a3062054553ab535e6981d37bd2 [term 1 FOLLOWER]: Refusing update from remote peer 3ef03187464842b58490b94757eaa020: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:34.191764 15269 raft_consensus.cc:1261] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 1 FOLLOWER]: Refusing update from remote peer 3ef03187464842b58490b94757eaa020: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:34.192085 15475 consensus_queue.cc:1035] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "876e9a3062054553ab535e6981d37bd2" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 42329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:34.192224 15477 consensus_queue.cc:1035] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3dac9f6e1184464d8d634f97d186ad52" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:34.195032 15482 mvcc.cc:205] Tried to move back new op lower bound from 7315575169807114240 to 7315575169773879296. Current Snapshot: MvccSnapshot[applied={T|T < 7315575169807114240}]
I20260806 15:11:34.195434 15481 mvcc.cc:205] Tried to move back new op lower bound from 7315575169807114240 to 7315575169773879296. Current Snapshot: MvccSnapshot[applied={T|T < 7315575169807114240 or (T in {7315575169807114240})}]
I20260806 15:11:34.196655 14987 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:34.196745 14987 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:34.197508 14987 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6ca2c9badb4b402092c5c792c442f5d7: Sending DeleteTablet for 3 replicas of tablet 2e3af1e53b53415782375bbfe25b7048
I20260806 15:11:34.197831 15385 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e3af1e53b53415782375bbfe25b7048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:34 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:40218
I20260806 15:11:34.197842 15248 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e3af1e53b53415782375bbfe25b7048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:34 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:40954
I20260806 15:11:34.197844 15113 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e3af1e53b53415782375bbfe25b7048 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:34 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:52182
I20260806 15:11:34.198093 15490 tablet_replica.cc:330] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: stopping tablet replica
I20260806 15:11:34.198201 15490 raft_consensus.cc:2229] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:34.198341 15492 tablet_replica.cc:330] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: stopping tablet replica
I20260806 15:11:34.198439 15492 raft_consensus.cc:2229] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:11:34.198468 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15050
I20260806 15:11:34.199674 15490 raft_consensus.cc:2258] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:34.199800 15492 raft_consensus.cc:2258] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:34.201011 15492 ts_tablet_manager.cc:1905] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:34.202893 15490 ts_tablet_manager.cc:1905] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:34.204784 15490 ts_tablet_manager.cc:1918] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:34.204864 15490 log.cc:1196] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/2e3af1e53b53415782375bbfe25b7048
I20260806 15:11:34.205139 15490 ts_tablet_manager.cc:1939] T 2e3af1e53b53415782375bbfe25b7048 P 3dac9f6e1184464d8d634f97d186ad52: Deleting consensus metadata
I20260806 15:11:34.205608 14974 catalog_manager.cc:4841] TS 3dac9f6e1184464d8d634f97d186ad52 (127.29.69.130:33511): tablet 2e3af1e53b53415782375bbfe25b7048 (table test-table [id=b8c4d25d4ab940a99a766009c78cf844]) successfully deleted
W20260806 15:11:34.207190 14974 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:42329 (error 108)
I20260806 15:11:34.207705 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15185
I20260806 15:11:34.208316 15461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.207872 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:42329 (local address 127.0.0.1:52194)
0806 15:11:34.208239 (+ 367us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.208281 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:42329: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":347}
W20260806 15:11:34.208544 14974 catalog_manager.cc:4584] TS 876e9a3062054553ab535e6981d37bd2 (127.29.69.129:42329): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2e3af1e53b53415782375bbfe25b7048: Network error: Client connection negotiation failed: client connection to 127.29.69.129:42329: connect: Connection refused (error 111)
I20260806 15:11:34.213205 15492 ts_tablet_manager.cc:1918] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:34.213333 15492 log.cc:1196] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/2e3af1e53b53415782375bbfe25b7048
I20260806 15:11:34.213613 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15320
I20260806 15:11:34.213668 15492 ts_tablet_manager.cc:1939] T 2e3af1e53b53415782375bbfe25b7048 P 3ef03187464842b58490b94757eaa020: Deleting consensus metadata
I20260806 15:11:34.219090 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 14955
I20260806 15:11:34.219125 15461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.218983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38773 (local address 127.0.0.1:40238)
0806 15:11:34.219057 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.219090 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.131:38773: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
2026-08-06T15:11:34Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1915 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-06T15:11:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:34Z Disabled control of system clock
I20260806 15:11:34.246692 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:34393
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:34393
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:34.325902 15497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:34.326108 15497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:34.326128 15497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:34.327270 15497 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:34.327312 15497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:34.327325 15497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:34.327337 15497 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:34.327349 15497 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:34.328608 15497 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:34393
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:34393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:34.328799 15497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:34.329031 15497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:34.333612 15503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.333678 15502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.333865 15497 server_base.cc:1034] running on GCE node
W20260806 15:11:34.333676 15505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.334175 15497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:34.334477 15497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:34.335660 15497 hybrid_clock.cc:648] HybridClock initialized: now 1786029094335646 us; error 32 us; skew 500 ppm
I20260806 15:11:34.336839 15497 webserver.cc:460] Webserver started at http://127.29.69.190:46741/ using document root <none> and password file <none>
I20260806 15:11:34.337088 15497 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:34.337158 15497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:34.337304 15497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:34.338378 15497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "a937810630d6434c81854d374d55bd57"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "3944bcf592780159aca41d7564d48e89"
server_key_iv: "2ead619d40d4c7cde41b0e4d1d4af913"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.338748 15497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "a937810630d6434c81854d374d55bd57"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "3944bcf592780159aca41d7564d48e89"
server_key_iv: "2ead619d40d4c7cde41b0e4d1d4af913"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.340193 15497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:34.340999 15511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.341172 15497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:34.341275 15497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "a937810630d6434c81854d374d55bd57"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "3944bcf592780159aca41d7564d48e89"
server_key_iv: "2ead619d40d4c7cde41b0e4d1d4af913"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.341356 15497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:34.354620 15497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:34.354933 15497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:34.355082 15497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:34.359133 15497 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:34393
I20260806 15:11:34.359162 15564 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:34393 every 8 connection(s)
I20260806 15:11:34.359493 15497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:34.360450 15565 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.360628 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15497
I20260806 15:11:34.360743 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:34.360930 29974 external_mini_cluster.cc:1428] Setting key 136e96dfb8522b73868e375f4efea4a3
I20260806 15:11:34.364140 15565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57: Bootstrap starting.
I20260806 15:11:34.364874 15565 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.365240 15565 log.cc:824] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.366189 15565 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57: No bootstrap required, opened a new log
I20260806 15:11:34.367180 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.361437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60974 (local address 127.29.69.190:34393)
0806 15:11:34.361638 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.361648 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.361680 (+ 32us) server_negotiation.cc:407] Connection header received
0806 15:11:34.362169 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.362178 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.362259 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.362432 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.362591 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.363948 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.365002 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.365471 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.365605 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.366383 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.366387 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.366388 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:34.366607 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.366651 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:34.366666 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.366728 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.366825 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.366950 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260806 15:11:34.368507 15565 raft_consensus.cc:348] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a937810630d6434c81854d374d55bd57" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34393 } }
I20260806 15:11:34.368636 15565 raft_consensus.cc:374] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.368659 15565 raft_consensus.cc:729] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a937810630d6434c81854d374d55bd57, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.368772 15565 consensus_queue.cc:260] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a937810630d6434c81854d374d55bd57" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34393 } }
I20260806 15:11:34.368847 15565 raft_consensus.cc:388] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:34.368870 15565 raft_consensus.cc:482] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:34.368897 15565 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.369382 15565 raft_consensus.cc:504] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a937810630d6434c81854d374d55bd57" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34393 } }
I20260806 15:11:34.369469 15565 leader_election.cc:302] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a937810630d6434c81854d374d55bd57; no voters:
I20260806 15:11:34.369596 15565 leader_election.cc:288] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:34.369655 15570 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:34.369831 15570 raft_consensus.cc:686] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [term 1 LEADER]: Becoming Leader. State: Replica: a937810630d6434c81854d374d55bd57, State: Running, Role: LEADER
I20260806 15:11:34.369867 15565 sys_catalog.cc:564] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:34.369946 15570 consensus_queue.cc:237] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a937810630d6434c81854d374d55bd57" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34393 } }
I20260806 15:11:34.370501 15571 sys_catalog.cc:455] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a937810630d6434c81854d374d55bd57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a937810630d6434c81854d374d55bd57" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34393 } } }
I20260806 15:11:34.370745 15571 sys_catalog.cc:458] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:34.370666 15572 sys_catalog.cc:455] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a937810630d6434c81854d374d55bd57. Latest consensus state: current_term: 1 leader_uuid: "a937810630d6434c81854d374d55bd57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a937810630d6434c81854d374d55bd57" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 34393 } } }
I20260806 15:11:34.371133 15579 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:34.371186 15572 sys_catalog.cc:458] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:34.371697 15579 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:34.373063 15579 catalog_manager.cc:1347] Generated new cluster ID: e6ff468ce4f9413ba5c49dec90a99b58
I20260806 15:11:34.373131 15579 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:34.388044 15579 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:34.388728 15579 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:34.398808 15579 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57: Generated new TSK 0
I20260806 15:11:34.399013 15579 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:34.402145 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34393
--builtin_ntp_servers=127.29.69.148:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:34.486805 15589 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:34.487038 15589 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:34.487076 15589 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:34.488245 15589 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:34.488309 15589 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:34.488353 15589 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:34.489754 15589 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15589
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:34.490034 15589 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:34.490379 15589 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:34.496169 15595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.496218 15597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.496230 15594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.496747 15589 server_base.cc:1034] running on GCE node
I20260806 15:11:34.496938 15589 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:34.497200 15589 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:34.498363 15589 hybrid_clock.cc:648] HybridClock initialized: now 1786029094498328 us; error 52 us; skew 500 ppm
I20260806 15:11:34.499761 15589 webserver.cc:460] Webserver started at http://127.29.69.129:45153/ using document root <none> and password file <none>
I20260806 15:11:34.500036 15589 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:34.500082 15589 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:34.500216 15589 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:34.501302 15589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "45ee870e28cf42f0991ee80539669932"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "647373f85d7e98c5654d5a5711fa9bcd"
server_key_iv: "58fba6877d9dfc639c437452d5f21086"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.501668 15589 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "45ee870e28cf42f0991ee80539669932"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "647373f85d7e98c5654d5a5711fa9bcd"
server_key_iv: "58fba6877d9dfc639c437452d5f21086"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.503115 15589 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:34.503875 15603 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.504082 15589 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:34.504171 15589 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "45ee870e28cf42f0991ee80539669932"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "647373f85d7e98c5654d5a5711fa9bcd"
server_key_iv: "58fba6877d9dfc639c437452d5f21086"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.504225 15589 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:34.517558 15589 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:34.517796 15589 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:34.517895 15589 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:34.518078 15589 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:34.518399 15589 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:34.518437 15589 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.518468 15589 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:34.518481 15589 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.523981 15589 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:35929
I20260806 15:11:34.524073 15717 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:35929 every 8 connection(s)
I20260806 15:11:34.524377 15589 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:34.529161 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15589
I20260806 15:11:34.529270 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:11:34.529518 29974 external_mini_cluster.cc:1428] Setting key 4e5959d27754b2ef4f67707d3bd0b1e7
I20260806 15:11:34.529767 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.525097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:49767 (local address 127.29.69.190:34393)
0806 15:11:34.525140 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.525142 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.525369 (+ 227us) server_negotiation.cc:407] Connection header received
0806 15:11:34.525905 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.525906 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.525924 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.525985 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.526743 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.527278 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.528286 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.528491 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.528563 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.529449 (+ 886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.529450 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.529450 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:34.529456 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.529475 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:34.529481 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.529543 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.529652 (+ 109us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.529684 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:11:34.529975 15720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.525058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34393 (local address 127.29.69.129:49767)
0806 15:11:34.525234 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.525266 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.525800 (+ 534us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.526051 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.526055 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.526066 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:34.526642 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.526648 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.527384 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.527385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.528182 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.528184 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.528586 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.528588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.528714 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.529277 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:34.529278 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:34.529317 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:34.529349 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:34.529551 (+ 202us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:34.529556 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:34.529576 (+ 20us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.529651 (+ 75us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.529756 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
I20260806 15:11:34.530539 15718 heartbeater.cc:347] Connected to a master server at 127.29.69.190:34393
I20260806 15:11:34.530593 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34393
--builtin_ntp_servers=127.29.69.148:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 15:11:34.530652 15718 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:34.530838 15718 heartbeater.cc:511] Master 127.29.69.190:34393 requested a full tablet report, sending...
I20260806 15:11:34.531360 15528 ts_manager.cc:194] Registered new tserver with Master: 45ee870e28cf42f0991ee80539669932 (127.29.69.129:35929)
I20260806 15:11:34.531981 15528 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.129:49767
W20260806 15:11:34.610649 15721 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:34.610837 15721 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:34.610858 15721 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:34.611925 15721 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:34.611958 15721 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:34.611984 15721 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:34.613245 15721 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15721
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:34.613422 15721 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:34.613663 15721 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:34.618491 15727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.618527 15726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.618523 15729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.618650 15721 server_base.cc:1034] running on GCE node
I20260806 15:11:34.618870 15721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:34.619133 15721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:34.620302 15721 hybrid_clock.cc:648] HybridClock initialized: now 1786029094620286 us; error 29 us; skew 500 ppm
I20260806 15:11:34.621485 15721 webserver.cc:460] Webserver started at http://127.29.69.130:36565/ using document root <none> and password file <none>
I20260806 15:11:34.621743 15721 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:34.621814 15721 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:34.621982 15721 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:34.623076 15721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "5c8b3efdecef4346b1024fe02421d6bd"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "893e7100ea55c7c197784bffd0b0ce64"
server_key_iv: "4486ecbf4b1f72af575687222c507b15"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.623433 15721 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "5c8b3efdecef4346b1024fe02421d6bd"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "893e7100ea55c7c197784bffd0b0ce64"
server_key_iv: "4486ecbf4b1f72af575687222c507b15"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.624761 15721 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:11:34.625550 15735 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.625717 15721 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:34.625818 15721 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "5c8b3efdecef4346b1024fe02421d6bd"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "893e7100ea55c7c197784bffd0b0ce64"
server_key_iv: "4486ecbf4b1f72af575687222c507b15"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.625900 15721 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:34.646135 15721 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:34.646485 15721 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:34.646646 15721 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:34.646878 15721 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:34.647226 15721 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:34.647279 15721 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.647315 15721 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:34.647342 15721 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.652988 15721 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:46275
I20260806 15:11:34.653038 15849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:46275 every 8 connection(s)
I20260806 15:11:34.653348 15721 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:34.655689 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15721
I20260806 15:11:34.655828 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:11:34.656018 29974 external_mini_cluster.cc:1428] Setting key a3145b2ac07fedebbd5261d5fa9ae44e
I20260806 15:11:34.657034 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34393
--builtin_ntp_servers=127.29.69.148:33729
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 15:11:34.659291 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.654069 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:52461 (local address 127.29.69.190:34393)
0806 15:11:34.654141 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.654143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.654410 (+ 267us) server_negotiation.cc:407] Connection header received
0806 15:11:34.654873 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.654874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.654883 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.654941 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.655634 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.656281 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.657739 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.657929 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.657987 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.658983 (+ 996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.658985 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.658985 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:34.658990 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.659008 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:34.659012 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.659074 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.659161 (+ 87us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.659189 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 15:11:34.659581 15852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.654041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34393 (local address 127.29.69.130:52461)
0806 15:11:34.654260 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.654326 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.654791 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.654998 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.655001 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.655009 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:34.655546 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.655553 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.656380 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.656381 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.657650 (+ 1269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.657654 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.658021 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.658022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.658187 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.658840 (+ 653us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:34.658841 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:34.658869 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:34.658891 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:34.659080 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:34.659084 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:34.659087 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.659138 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.659219 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":89,"threads_started":1}
I20260806 15:11:34.660192 15850 heartbeater.cc:347] Connected to a master server at 127.29.69.190:34393
I20260806 15:11:34.660291 15850 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:34.660491 15850 heartbeater.cc:511] Master 127.29.69.190:34393 requested a full tablet report, sending...
I20260806 15:11:34.660861 15528 ts_manager.cc:194] Registered new tserver with Master: 5c8b3efdecef4346b1024fe02421d6bd (127.29.69.130:46275)
I20260806 15:11:34.661232 15528 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.130:52461
W20260806 15:11:34.739184 15853 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:34.739367 15853 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:34.739387 15853 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:34.740571 15853 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:34.740612 15853 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:34.740638 15853 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:34.742031 15853 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33729
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:34393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15853
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:34.742276 15853 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:34.742594 15853 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:34.747331 15858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.747331 15859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:34.747345 15861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:34.747740 15853 server_base.cc:1034] running on GCE node
I20260806 15:11:34.747910 15853 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:34.748136 15853 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:34.749272 15853 hybrid_clock.cc:648] HybridClock initialized: now 1786029094749256 us; error 31 us; skew 500 ppm
I20260806 15:11:34.750535 15853 webserver.cc:460] Webserver started at http://127.29.69.131:36281/ using document root <none> and password file <none>
I20260806 15:11:34.750782 15853 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:34.750828 15853 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:34.750998 15853 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:34.752022 15853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "9fbe0c0012b4428cbf3403083145f802"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "388f907542bea3d2ee777a9e2c3f98e9"
server_key_iv: "61db1511f4f3cb12a54c9a58600905f8"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.752369 15853 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "9fbe0c0012b4428cbf3403083145f802"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "388f907542bea3d2ee777a9e2c3f98e9"
server_key_iv: "61db1511f4f3cb12a54c9a58600905f8"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.753641 15853 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:34.754360 15867 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.754534 15853 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:34.754633 15853 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "9fbe0c0012b4428cbf3403083145f802"
format_stamp: "Formatted at 2026-08-06 15:11:34 on dist-test-slave-tm1g"
server_key: "388f907542bea3d2ee777a9e2c3f98e9"
server_key_iv: "61db1511f4f3cb12a54c9a58600905f8"
server_key_version: "encryptionkey@0"
I20260806 15:11:34.754716 15853 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:34.765256 15853 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:34.765538 15853 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:34.765681 15853 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:34.765887 15853 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:34.766207 15853 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:34.766263 15853 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.766323 15853 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:34.766357 15853 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:34.772289 15853 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:35737
I20260806 15:11:34.772341 15981 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:35737 every 8 connection(s)
I20260806 15:11:34.772640 15853 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:11:34.772922 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 15853
I20260806 15:11:34.773026 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:11:34.773233 29974 external_mini_cluster.cc:1428] Setting key 12a5ba5f689489f8c45d50b40615b2c3
I20260806 15:11:34.777856 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.773437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:59195 (local address 127.29.69.190:34393)
0806 15:11:34.773507 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.773510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.773693 (+ 183us) server_negotiation.cc:407] Connection header received
0806 15:11:34.774317 (+ 624us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.774319 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.774331 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.774384 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.775055 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.775569 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.776547 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.776764 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.776840 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.777592 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.777593 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.777594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:34.777599 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.777616 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:34.777620 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.777668 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.777752 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.777778 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260806 15:11:34.778066 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.773377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:34393 (local address 127.29.69.131:59195)
0806 15:11:34.773576 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.773619 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.774193 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.774472 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.774476 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.774492 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:34.774961 (+ 469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.774964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.775666 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.775668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.776452 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.776454 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.776848 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.776849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.776994 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.777455 (+ 461us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:34.777455 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:34.777481 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:34.777502 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:34.777667 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:34.777673 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:34.777676 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.777746 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.777845 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":86,"threads_started":1}
I20260806 15:11:34.778585 15982 heartbeater.cc:347] Connected to a master server at 127.29.69.190:34393
I20260806 15:11:34.778661 15982 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:34.778793 15982 heartbeater.cc:511] Master 127.29.69.190:34393 requested a full tablet report, sending...
I20260806 15:11:34.779130 15528 ts_manager.cc:194] Registered new tserver with Master: 9fbe0c0012b4428cbf3403083145f802 (127.29.69.131:35737)
I20260806 15:11:34.779458 15528 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.131:59195
I20260806 15:11:34.785001 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:11:34.789084 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.786417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60986 (local address 127.29.69.190:34393)
0806 15:11:34.786480 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.786482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.786613 (+ 131us) server_negotiation.cc:407] Connection header received
0806 15:11:34.786648 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.786648 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.786657 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.786702 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:34.786844 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.787286 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.787997 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.788167 (+ 170us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.788214 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.788861 (+ 647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:34.788862 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:34.788862 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:34.788866 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:34.788877 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:34.788881 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:34.788933 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.788974 (+ 41us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.788991 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:11:34.790819 15528 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:11:34.792398 15528 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:11:34.798661 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.794657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:46275 (local address 127.0.0.1:49786)
0806 15:11:34.794870 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.794911 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.794983 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.795322 (+ 339us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.795325 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.795329 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.795397 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.795399 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.796362 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.796363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.797531 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.797534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.798362 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.798363 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.798456 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.798470 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.798541 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.798589 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"thread_start_us":83,"threads_started":1}
I20260806 15:11:34.798686 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.794854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49786 (local address 127.29.69.130:46275)
0806 15:11:34.795148 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.795154 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.795163 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:34.795204 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.795205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.795220 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.795486 (+ 266us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.795564 (+ 78us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.796271 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.797607 (+ 1336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.798254 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.798360 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.798455 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.798553 (+ 98us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.798592 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":255,"thread_start_us":87,"threads_started":1}
I20260806 15:11:34.798943 15994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.794657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:35737 (local address 127.0.0.1:54822)
0806 15:11:34.794976 (+ 319us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.794986 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.795026 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.795449 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.795450 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.795453 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.795510 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.795512 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.796852 (+ 1340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.796853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.797820 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.797822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.798740 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.798741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.798818 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.798822 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.798852 (+ 30us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.798897 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":4,"thread_start_us":53,"threads_started":1}
I20260806 15:11:34.799268 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.794750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54822 (local address 127.29.69.131:35737)
0806 15:11:34.795270 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.795274 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.795283 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:34.795318 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.795320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.795336 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.795590 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.795646 (+ 56us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.796750 (+ 1104us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.797896 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.798637 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.799023 (+ 386us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.799122 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.799148 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.799197 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":100,"threads_started":1}
I20260806 15:11:34.799688 15783 tablet_service.cc:1467] Processing CreateTablet for tablet 5c22cc02278646eaab2b52460c772f65 (DEFAULT_TABLE table=test-table [id=e9c4e6db01fe4989a7689aa387cf38ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:34.799952 15915 tablet_service.cc:1467] Processing CreateTablet for tablet 5c22cc02278646eaab2b52460c772f65 (DEFAULT_TABLE table=test-table [id=e9c4e6db01fe4989a7689aa387cf38ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:34.800091 15783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c22cc02278646eaab2b52460c772f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.800233 15992 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.794841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:35929 (local address 127.0.0.1:50114)
0806 15:11:34.795089 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.795099 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.795135 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.795510 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.795511 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.795513 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.795549 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.795550 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.797888 (+ 2338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.797889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.798724 (+ 835us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.798727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.799993 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.799994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.800060 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.800063 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.800126 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.800165 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"thread_start_us":75,"threads_started":1}
I20260806 15:11:34.800304 15996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.795062 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50114 (local address 127.29.69.129:35929)
0806 15:11:34.795224 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.795228 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.795240 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:11:34.795347 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.795350 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.795368 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.795440 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.795625 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.796750 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.798833 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.799788 (+ 955us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.799860 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.799945 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.800162 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.800205 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":88,"threads_started":1}
I20260806 15:11:34.800307 15915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c22cc02278646eaab2b52460c772f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.802806 15997 tablet_bootstrap.cc:492] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Bootstrap starting.
I20260806 15:11:34.803270 15998 tablet_bootstrap.cc:492] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Bootstrap starting.
I20260806 15:11:34.803514 15651 tablet_service.cc:1467] Processing CreateTablet for tablet 5c22cc02278646eaab2b52460c772f65 (DEFAULT_TABLE table=test-table [id=e9c4e6db01fe4989a7689aa387cf38ac]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:34.803736 15997 tablet_bootstrap.cc:654] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.803854 15651 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5c22cc02278646eaab2b52460c772f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:34.803941 15998 tablet_bootstrap.cc:654] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.804101 15997 log.cc:824] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.804265 15998 log.cc:824] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.804819 15997 tablet_bootstrap.cc:492] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: No bootstrap required, opened a new log
I20260806 15:11:34.804906 15997 ts_tablet_manager.cc:1397] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:34.806929 15998 tablet_bootstrap.cc:492] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: No bootstrap required, opened a new log
I20260806 15:11:34.806923 16001 tablet_bootstrap.cc:492] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: Bootstrap starting.
I20260806 15:11:34.807116 15998 ts_tablet_manager.cc:1397] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260806 15:11:34.807425 15997 raft_consensus.cc:348] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.807583 16001 tablet_bootstrap.cc:654] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:34.807603 15997 raft_consensus.cc:374] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.807644 15997 raft_consensus.cc:729] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c8b3efdecef4346b1024fe02421d6bd, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.807826 15997 consensus_queue.cc:260] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.807905 16001 log.cc:824] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:34.808128 15997 ts_tablet_manager.cc:1428] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:34.808254 15850 heartbeater.cc:503] Master 127.29.69.190:34393 was elected leader, sending a full tablet report...
I20260806 15:11:34.808666 16001 tablet_bootstrap.cc:492] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: No bootstrap required, opened a new log
I20260806 15:11:34.808753 16001 ts_tablet_manager.cc:1397] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:34.809653 15998 raft_consensus.cc:348] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.809772 15998 raft_consensus.cc:374] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.809793 15998 raft_consensus.cc:729] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fbe0c0012b4428cbf3403083145f802, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.809911 15998 consensus_queue.cc:260] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.810158 15998 ts_tablet_manager.cc:1428] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:34.810232 15982 heartbeater.cc:503] Master 127.29.69.190:34393 was elected leader, sending a full tablet report...
I20260806 15:11:34.811265 16001 raft_consensus.cc:348] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.811407 16001 raft_consensus.cc:374] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:34.811461 16001 raft_consensus.cc:729] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45ee870e28cf42f0991ee80539669932, State: Initialized, Role: FOLLOWER
I20260806 15:11:34.811595 16001 consensus_queue.cc:260] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.811830 16001 ts_tablet_manager.cc:1428] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:34.811882 15718 heartbeater.cc:503] Master 127.29.69.190:34393 was elected leader, sending a full tablet report...
W20260806 15:11:34.903980 15851 tablet.cc:2369] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:11:34.967677 16004 raft_consensus.cc:482] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:34.967810 16004 raft_consensus.cc:504] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.968237 16004 leader_election.cc:288] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5c8b3efdecef4346b1024fe02421d6bd (127.29.69.130:46275), 45ee870e28cf42f0991ee80539669932 (127.29.69.129:35929)
I20260806 15:11:34.971278 15985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.968401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:46275 (local address 127.29.69.131:47681)
0806 15:11:34.968458 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.968470 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.968521 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.968693 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.968695 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.968697 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.968791 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.968793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.969444 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.969445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.970438 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.970441 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.971010 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.971012 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.971083 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.971086 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.971162 (+ 76us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.971206 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":42}
I20260806 15:11:34.971278 15995 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.968490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:47681 (local address 127.29.69.130:46275)
0806 15:11:34.968535 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.968538 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.968552 (+ 14us) server_negotiation.cc:407] Connection header received
0806 15:11:34.968590 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.968591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.968601 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.968676 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.968871 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.969352 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.970539 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.970904 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.971013 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.971021 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.971167 (+ 146us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.971206 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:11:34.971606 16006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.968543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:35929 (local address 127.29.69.131:52749)
0806 15:11:34.968744 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:34.968752 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:34.968815 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:34.968961 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:34.968962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:34.968963 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:34.969041 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.969043 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.969687 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.969688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.970658 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:34.970660 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.971292 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.971294 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:34.971387 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.971391 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:34.971492 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 15:11:34.971528 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":2,"thread_start_us":120,"threads_started":1}
I20260806 15:11:34.971621 15996 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:34.968623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:52749 (local address 127.29.69.129:35929)
0806 15:11:34.968691 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:34.968694 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:34.968804 (+ 110us) server_negotiation.cc:407] Connection header received
0806 15:11:34.968873 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:34.968874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:34.968882 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:34.968957 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:34.969115 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.969593 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.970746 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:34.971201 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:34.971284 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:34.971292 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:34.971504 (+ 212us) server_negotiation.cc:299] Negotiation successful
0806 15:11:34.971553 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:11:34.971654 15803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c22cc02278646eaab2b52460c772f65" candidate_uuid: "9fbe0c0012b4428cbf3403083145f802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b3efdecef4346b1024fe02421d6bd" is_pre_election: true
I20260806 15:11:34.971800 15803 raft_consensus.cc:2454] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbe0c0012b4428cbf3403083145f802 in term 0.
I20260806 15:11:34.972071 15868 leader_election.cc:302] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c8b3efdecef4346b1024fe02421d6bd, 9fbe0c0012b4428cbf3403083145f802; no voters:
I20260806 15:11:34.972103 15671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c22cc02278646eaab2b52460c772f65" candidate_uuid: "9fbe0c0012b4428cbf3403083145f802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ee870e28cf42f0991ee80539669932" is_pre_election: true
I20260806 15:11:34.972237 15671 raft_consensus.cc:2454] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fbe0c0012b4428cbf3403083145f802 in term 0.
I20260806 15:11:34.972234 16004 raft_consensus.cc:2781] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:11:34.972301 16004 raft_consensus.cc:482] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:11:34.972390 16004 raft_consensus.cc:3037] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.973150 16004 raft_consensus.cc:504] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.973285 16004 leader_election.cc:288] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [CANDIDATE]: Term 1 election: Requested vote from peers 5c8b3efdecef4346b1024fe02421d6bd (127.29.69.130:46275), 45ee870e28cf42f0991ee80539669932 (127.29.69.129:35929)
I20260806 15:11:34.973438 15803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c22cc02278646eaab2b52460c772f65" candidate_uuid: "9fbe0c0012b4428cbf3403083145f802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c8b3efdecef4346b1024fe02421d6bd"
I20260806 15:11:34.973464 15671 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c22cc02278646eaab2b52460c772f65" candidate_uuid: "9fbe0c0012b4428cbf3403083145f802" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45ee870e28cf42f0991ee80539669932"
I20260806 15:11:34.973527 15803 raft_consensus.cc:3037] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.973546 15671 raft_consensus.cc:3037] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:34.974485 15803 raft_consensus.cc:2454] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbe0c0012b4428cbf3403083145f802 in term 1.
I20260806 15:11:34.974594 15671 raft_consensus.cc:2454] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fbe0c0012b4428cbf3403083145f802 in term 1.
I20260806 15:11:34.974761 15868 leader_election.cc:302] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45ee870e28cf42f0991ee80539669932, 9fbe0c0012b4428cbf3403083145f802; no voters:
I20260806 15:11:34.974859 16004 raft_consensus.cc:2781] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:34.975005 16004 raft_consensus.cc:686] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 1 LEADER]: Becoming Leader. State: Replica: 9fbe0c0012b4428cbf3403083145f802, State: Running, Role: LEADER
I20260806 15:11:34.975107 16004 consensus_queue.cc:237] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } }
I20260806 15:11:34.975883 15528 catalog_manager.cc:5495] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9fbe0c0012b4428cbf3403083145f802 (127.29.69.131). New cstate: current_term: 1 leader_uuid: "9fbe0c0012b4428cbf3403083145f802" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fbe0c0012b4428cbf3403083145f802" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 35737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 } health_report { overall_health: UNKNOWN } } }
W20260806 15:11:35.023193 15983 tablet.cc:2369] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:11:35.023847 15993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:35.021426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54828 (local address 127.29.69.131:35737)
0806 15:11:35.021492 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:35.021494 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:35.021508 (+ 14us) server_negotiation.cc:407] Connection header received
0806 15:11:35.021550 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:35.021551 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:35.021569 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:35.021630 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:11:35.021750 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:35.022274 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:35.023036 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:35.023222 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:35.023301 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:35.023496 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:11:35.023596 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:11:35.023688 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:35.023714 (+ 26us) server_negotiation.cc:299] Negotiation successful
0806 15:11:35.023733 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
W20260806 15:11:35.025113 15719 tablet.cc:2369] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:11:35.025722 15671 raft_consensus.cc:1261] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 1 FOLLOWER]: Refusing update from remote peer 9fbe0c0012b4428cbf3403083145f802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:35.025784 15803 raft_consensus.cc:1261] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 1 FOLLOWER]: Refusing update from remote peer 9fbe0c0012b4428cbf3403083145f802: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:35.026136 16007 consensus_queue.cc:1035] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45ee870e28cf42f0991ee80539669932" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 35929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:35.026268 16004 consensus_queue.cc:1035] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c8b3efdecef4346b1024fe02421d6bd" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 46275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:35.029735 16012 mvcc.cc:205] Tried to move back new op lower bound from 7315575173222440960 to 7315575173018640384. Current Snapshot: MvccSnapshot[applied={T|T < 7315575173222440960}]
I20260806 15:11:35.030754 15527 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:35.030854 15527 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:60986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:35.031683 15527 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a937810630d6434c81854d374d55bd57: Sending DeleteTablet for 3 replicas of tablet 5c22cc02278646eaab2b52460c772f65
I20260806 15:11:35.032024 15783 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c22cc02278646eaab2b52460c772f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:35 UTC) from {username='slave'} at 127.0.0.1:49786
I20260806 15:11:35.032042 15915 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c22cc02278646eaab2b52460c772f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:35 UTC) from {username='slave'} at 127.0.0.1:54822
I20260806 15:11:35.032039 15651 tablet_service.cc:1514] Processing DeleteTablet for tablet 5c22cc02278646eaab2b52460c772f65 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:35 UTC) from {username='slave'} at 127.0.0.1:50114
I20260806 15:11:35.032233 16020 tablet_replica.cc:330] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932: stopping tablet replica
I20260806 15:11:35.032338 16020 raft_consensus.cc:2229] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:35.032397 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15589
I20260806 15:11:35.032454 16020 raft_consensus.cc:2258] T 5c22cc02278646eaab2b52460c772f65 P 45ee870e28cf42f0991ee80539669932 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:35.033144 16021 tablet_replica.cc:330] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: stopping tablet replica
I20260806 15:11:35.033236 16021 raft_consensus.cc:2229] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:11:35.033315 16021 raft_consensus.cc:2258] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:35.033738 16021 ts_tablet_manager.cc:1905] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:35.035470 16021 ts_tablet_manager.cc:1918] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:35.035599 16021 log.cc:1196] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/5c22cc02278646eaab2b52460c772f65
I20260806 15:11:35.035941 16021 ts_tablet_manager.cc:1939] T 5c22cc02278646eaab2b52460c772f65 P 9fbe0c0012b4428cbf3403083145f802: Deleting consensus metadata
I20260806 15:11:35.036412 15513 catalog_manager.cc:4841] TS 9fbe0c0012b4428cbf3403083145f802 (127.29.69.131:35737): tablet 5c22cc02278646eaab2b52460c772f65 (table test-table [id=e9c4e6db01fe4989a7689aa387cf38ac]) successfully deleted
W20260806 15:11:35.038697 15512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:35929 (error 108)
I20260806 15:11:35.038770 16022 tablet_replica.cc:330] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: stopping tablet replica
I20260806 15:11:35.038864 16022 raft_consensus.cc:2229] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:35.038971 16022 raft_consensus.cc:2258] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:35.039417 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:35.039277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:35929 (local address 127.0.0.1:50120)
0806 15:11:35.039337 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:35.039377 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:35929: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 15:11:35.039499 16022 ts_tablet_manager.cc:1905] T 5c22cc02278646eaab2b52460c772f65 P 5c8b3efdecef4346b1024fe02421d6bd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:35.039574 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15721
W20260806 15:11:35.039602 15512 catalog_manager.cc:4584] TS 45ee870e28cf42f0991ee80539669932 (127.29.69.129:35929): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5c22cc02278646eaab2b52460c772f65: Network error: Client connection negotiation failed: client connection to 127.29.69.129:35929: connect: Connection refused (error 111)
I20260806 15:11:35.045576 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15853
I20260806 15:11:35.045699 15991 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:35.045569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:46275 (local address 127.0.0.1:49790)
0806 15:11:35.045640 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:35.045672 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.130:46275: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 15:11:35.050083 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 15497
2026-08-06T15:11:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (830 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:35 dist-test-slave-tm1g krb5kdc[16026](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:35 dist-test-slave-tm1g krb5kdc[16026](info): set up 2 sockets
Aug 06 15:11:35 dist-test-slave-tm1g krb5kdc[16026](info): commencing operation
krb5kdc: starting...
W20260806 15:11:36.103503 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:11:36.241852 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:44281
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:44281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:36.325033 16039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:36.325263 16039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:36.325299 16039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:36.326498 16039 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:36.326556 16039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:36.326578 16039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:36.326601 16039 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:36.326627 16039 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:36.328075 16039 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:44281
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:44281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:36.328341 16039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:36.328611 16039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:36.333468 16044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:36.333514 16045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.333580 16039 server_base.cc:1034] running on GCE node
W20260806 15:11:36.333469 16047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.333884 16039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:36.334120 16039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:36.335296 16039 hybrid_clock.cc:648] HybridClock initialized: now 1786029096335267 us; error 52 us; skew 500 ppm
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:36.337848 16039 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:11:36.338274 16039 webserver.cc:460] Webserver started at http://127.29.69.190:45035/ using document root <none> and password file <none>
I20260806 15:11:36.338516 16039 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:36.338562 16039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:36.338706 16039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:36.339754 16039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "1fbbf6bf09634e8496031a969516942a"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "f553861aa903923c875f3ee14dce0dea"
server_key_iv: "74a7304b071eb37edd1fc5e6e0bae884"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.340127 16039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "1fbbf6bf09634e8496031a969516942a"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "f553861aa903923c875f3ee14dce0dea"
server_key_iv: "74a7304b071eb37edd1fc5e6e0bae884"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.341512 16039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:36.342379 16054 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.342585 16039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:36.342692 16039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "1fbbf6bf09634e8496031a969516942a"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "f553861aa903923c875f3ee14dce0dea"
server_key_iv: "74a7304b071eb37edd1fc5e6e0bae884"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.342779 16039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:36.352593 16039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:36.354930 16039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:36.355098 16039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:36.359206 16039 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:44281
I20260806 15:11:36.359239 16106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:44281 every 8 connection(s)
I20260806 15:11:36.359565 16039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:36.360488 16107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:36.362819 16107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a: Bootstrap starting.
I20260806 15:11:36.363544 16107 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:36.363862 16107 log.cc:824] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:36.364588 16107 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a: No bootstrap required, opened a new log
I20260806 15:11:36.366154 16107 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fbbf6bf09634e8496031a969516942a" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44281 } }
I20260806 15:11:36.366288 16107 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:36.366396 16107 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fbbf6bf09634e8496031a969516942a, State: Initialized, Role: FOLLOWER
I20260806 15:11:36.366546 16107 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fbbf6bf09634e8496031a969516942a" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44281 } }
I20260806 15:11:36.366612 16107 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:36.366634 16107 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:36.366698 16107 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:36.367244 16107 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fbbf6bf09634e8496031a969516942a" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44281 } }
I20260806 15:11:36.367321 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16039
I20260806 15:11:36.367328 16107 leader_election.cc:302] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fbbf6bf09634e8496031a969516942a; no voters:
I20260806 15:11:36.367431 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:36.367542 16107 leader_election.cc:288] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:36.367578 16110 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:36.367633 29974 external_mini_cluster.cc:1428] Setting key df79ac308329b816ad7514cb67e427c0
I20260806 15:11:36.367717 16110 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [term 1 LEADER]: Becoming Leader. State: Replica: 1fbbf6bf09634e8496031a969516942a, State: Running, Role: LEADER
I20260806 15:11:36.367801 16110 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fbbf6bf09634e8496031a969516942a" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44281 } }
I20260806 15:11:36.367833 16107 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:36.368435 16110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fbbf6bf09634e8496031a969516942a. Latest consensus state: current_term: 1 leader_uuid: "1fbbf6bf09634e8496031a969516942a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fbbf6bf09634e8496031a969516942a" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44281 } } }
I20260806 15:11:36.368528 16110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:36.368588 16111 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fbbf6bf09634e8496031a969516942a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fbbf6bf09634e8496031a969516942a" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44281 } } }
I20260806 15:11:36.368669 16111 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:36.368743 16118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:36.369302 16118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:36.371004 16118 catalog_manager.cc:1347] Generated new cluster ID: af0f26e674ad4f6db7a4a32dcf0dc903
I20260806 15:11:36.371060 16118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:36.380100 16115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.368352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33658 (local address 127.29.69.190:44281)
0806 15:11:36.368556 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.368568 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.368612 (+ 44us) server_negotiation.cc:407] Connection header received
0806 15:11:36.369026 (+ 414us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.369035 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.369093 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.369217 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:36.370128 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.371507 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.372585 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.373212 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.373320 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.376210 (+ 2890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:36.376213 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:36.376214 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:36.376226 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:36.378533 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.378898 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.378901 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.378901 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.379017 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.379236 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.379237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.379237 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.379481 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:36.379671 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.379738 (+ 67us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.379883 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":74,"threads_started":1}
I20260806 15:11:36.382025 16118 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:36.382733 16118 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:36.385268 16118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a: Generated new TSK 0
I20260806 15:11:36.385456 16118 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:11:36.422641 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44281
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:36.527690 16133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:36.527911 16133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:36.527951 16133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:36.529106 16133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:36.529173 16133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:36.529217 16133 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:36.530859 16133 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:36.531124 16133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:36.531342 16133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:36.536726 16139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:36.536705 16142 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.536994 16133 server_base.cc:1034] running on GCE node
W20260806 15:11:36.536705 16140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.537294 16133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:36.537570 16133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:36.538718 16133 hybrid_clock.cc:648] HybridClock initialized: now 1786029096538703 us; error 32 us; skew 500 ppm
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:36.541174 16133 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:11:36.541602 16133 webserver.cc:460] Webserver started at http://127.29.69.129:39309/ using document root <none> and password file <none>
I20260806 15:11:36.541826 16133 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:36.541868 16133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:36.542048 16133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:36.543140 16133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "c8f886ba8e84449699b38250d6ca42cc"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "175e66e73950b07247078749046fe5a2"
server_key_iv: "6bdd94d5ab9e8d02922c16ab3fcf955c"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.543507 16133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "c8f886ba8e84449699b38250d6ca42cc"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "175e66e73950b07247078749046fe5a2"
server_key_iv: "6bdd94d5ab9e8d02922c16ab3fcf955c"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.544879 16133 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:36.545807 16149 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.546054 16133 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:36.546258 16133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "c8f886ba8e84449699b38250d6ca42cc"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "175e66e73950b07247078749046fe5a2"
server_key_iv: "6bdd94d5ab9e8d02922c16ab3fcf955c"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.546377 16133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:36.556303 16133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:36.558249 16133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:36.558456 16133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:36.558707 16133 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:36.559015 16133 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:36.559070 16133 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.559106 16133 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:36.559134 16133 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.564983 16133 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:39699
I20260806 15:11:36.565064 16264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:39699 every 8 connection(s)
I20260806 15:11:36.565390 16133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:36.568097 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16133
I20260806 15:11:36.568184 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:11:36.568413 29974 external_mini_cluster.cc:1428] Setting key 3d744ccd137a9a586d2dad632e45cf88
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:36.575822 16115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.566159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:42783 (local address 127.29.69.190:44281)
0806 15:11:36.566230 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.566232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.566447 (+ 215us) server_negotiation.cc:407] Connection header received
0806 15:11:36.566928 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.566929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.566943 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.566991 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:36.567914 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.568588 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.570009 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.570212 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.570341 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.572865 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:36.572866 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:36.572867 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:36.572874 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:36.574265 (+ 1391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.574845 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.574846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.574846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.574900 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.575190 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.575191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.575191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.575293 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:36.575344 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.575690 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.575758 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:11:36.576098 16268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.566123 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44281 (local address 127.29.69.129:42783)
0806 15:11:36.566292 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.566359 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.566847 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.567049 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.567052 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.567621 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:36.567815 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.567820 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.568698 (+ 878us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.568699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.569927 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.569930 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.570364 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.570366 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.570523 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.571060 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:36.571068 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:36.572776 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:36.574396 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:36.574405 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:36.574408 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:36.574768 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:36.574969 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:36.574971 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:36.574971 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:36.575124 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:36.575360 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:36.575368 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:36.575537 (+ 169us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.575670 (+ 133us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.575854 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
I20260806 15:11:36.576704 16265 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44281
I20260806 15:11:36.576797 16265 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:36.576997 16265 heartbeater.cc:511] Master 127.29.69.190:44281 requested a full tablet report, sending...
I20260806 15:11:36.577534 16071 ts_manager.cc:194] Registered new tserver with Master: c8f886ba8e84449699b38250d6ca42cc (127.29.69.129:39699)
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
I20260806 15:11:36.578171 16071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:42783
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:11:36.596845 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44281
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:36.678404 16271 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:36.678627 16271 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:36.678663 16271 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:36.679800 16271 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:36.679867 16271 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:36.679910 16271 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:36.681349 16271 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16271
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:36.681599 16271 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:36.681821 16271 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:36.686772 16277 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:36.686748 16276 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:36.686757 16279 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.687016 16271 server_base.cc:1034] running on GCE node
I20260806 15:11:36.687213 16271 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:36.687458 16271 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:36.688637 16271 hybrid_clock.cc:648] HybridClock initialized: now 1786029096688632 us; error 39 us; skew 500 ppm
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:36.691347 16271 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:11:36.691784 16271 webserver.cc:460] Webserver started at http://127.29.69.130:46133/ using document root <none> and password file <none>
I20260806 15:11:36.692020 16271 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:36.692065 16271 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:36.692209 16271 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:36.693243 16271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "2a629233b4f34bf0a8ebb7c2201657ac"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "fba993cf6abfc7a43709e5660f6c732e"
server_key_iv: "67adeac298f9c54a844f7c99a4245aa5"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.693610 16271 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "2a629233b4f34bf0a8ebb7c2201657ac"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "fba993cf6abfc7a43709e5660f6c732e"
server_key_iv: "67adeac298f9c54a844f7c99a4245aa5"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.695050 16271 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:36.695889 16286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.696089 16271 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:36.696199 16271 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "2a629233b4f34bf0a8ebb7c2201657ac"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "fba993cf6abfc7a43709e5660f6c732e"
server_key_iv: "67adeac298f9c54a844f7c99a4245aa5"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.696275 16271 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:36.719693 16271 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:36.722028 16271 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:36.722194 16271 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:36.722491 16271 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:36.722811 16271 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:36.722874 16271 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.722914 16271 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:36.722944 16271 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.728747 16271 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:40911
I20260806 15:11:36.728794 16400 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:40911 every 8 connection(s)
I20260806 15:11:36.729112 16271 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:36.731904 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16271
I20260806 15:11:36.732030 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:11:36.732223 29974 external_mini_cluster.cc:1428] Setting key d183b9e54095ed8e1d23cf4c25465904
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:36.739105 16115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.729789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:45455 (local address 127.29.69.190:44281)
0806 15:11:36.729865 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.729867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.730122 (+ 255us) server_negotiation.cc:407] Connection header received
0806 15:11:36.730669 (+ 547us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.730670 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.730681 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.730731 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:36.731593 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.732361 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.733490 (+ 1129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.733704 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.733784 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.735884 (+ 2100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:36.735886 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:36.735886 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:36.735894 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:36.737572 (+ 1678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.737965 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.737966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.737966 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.738032 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.738338 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.738339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.738339 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.738507 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:36.738585 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.738911 (+ 326us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.739001 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 15:11:36.739169 16403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.729773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44281 (local address 127.29.69.130:45455)
0806 15:11:36.729959 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.730022 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.730579 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.730781 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.730785 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.731327 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:36.731519 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.731523 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.732475 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.732477 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.733366 (+ 889us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.733369 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.733793 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.733794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.733926 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.734451 (+ 525us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:36.734459 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:36.735792 (+ 1333us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:36.737666 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:36.737673 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:36.737674 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:36.737889 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:36.738124 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:36.738125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:36.738126 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:36.738237 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:36.738630 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:36.738644 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:36.738762 (+ 118us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.738863 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.738988 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":99,"threads_started":1}
I20260806 15:11:36.739732 16401 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44281
I20260806 15:11:36.739850 16401 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:36.740023 16401 heartbeater.cc:511] Master 127.29.69.190:44281 requested a full tablet report, sending...
I20260806 15:11:36.740451 16071 ts_manager.cc:194] Registered new tserver with Master: 2a629233b4f34bf0a8ebb7c2201657ac (127.29.69.130:40911)
I20260806 15:11:36.740998 16071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:45455
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:11:36.757396 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44281
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:42373
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:36.837919 16406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:36.838162 16406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:36.838201 16406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:36.839373 16406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:36.839447 16406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:36.839488 16406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:36.840888 16406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:42373
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44281
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:36.841150 16406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:36.841377 16406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:36.846347 16412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:36.846356 16411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.846437 16406 server_base.cc:1034] running on GCE node
W20260806 15:11:36.846405 16414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:36.846761 16406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:36.847018 16406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:36.848188 16406 hybrid_clock.cc:648] HybridClock initialized: now 1786029096848176 us; error 27 us; skew 500 ppm
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:36.856154 16406 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:11:36.856622 16406 webserver.cc:460] Webserver started at http://127.29.69.131:39149/ using document root <none> and password file <none>
I20260806 15:11:36.856848 16406 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:36.856914 16406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:36.857074 16406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:36.858124 16406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "3ce8bda5a43c475aad63b8a19229797c"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "ea3c1d143f6efbda0d2eb672ac15c29d"
server_key_iv: "027759719aaa4f24eb682e5e5e4e4584"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.858506 16406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "3ce8bda5a43c475aad63b8a19229797c"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "ea3c1d143f6efbda0d2eb672ac15c29d"
server_key_iv: "027759719aaa4f24eb682e5e5e4e4584"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.859829 16406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:36.860562 16422 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.860734 16406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:36.860836 16406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "3ce8bda5a43c475aad63b8a19229797c"
format_stamp: "Formatted at 2026-08-06 15:11:36 on dist-test-slave-tm1g"
server_key: "ea3c1d143f6efbda0d2eb672ac15c29d"
server_key_iv: "027759719aaa4f24eb682e5e5e4e4584"
server_key_version: "encryptionkey@0"
I20260806 15:11:36.860917 16406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:36.869365 16406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:36.871291 16406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:36.871447 16406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:36.871685 16406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:36.871996 16406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:36.872051 16406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.872093 16406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:36.872120 16406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:36.878003 16406 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:32915
I20260806 15:11:36.878077 16536 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:32915 every 8 connection(s)
I20260806 15:11:36.878485 16406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:11:36.881925 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16406
I20260806 15:11:36.882011 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:11:36.882182 29974 external_mini_cluster.cc:1428] Setting key c016373e1544d1f027049c58863fe8b7
Aug 06 15:11:36 dist-test-slave-tm1g krb5kdc[16026](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029096, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:36.888263 16115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.879211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:47775 (local address 127.29.69.190:44281)
0806 15:11:36.879275 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.879277 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.879487 (+ 210us) server_negotiation.cc:407] Connection header received
0806 15:11:36.879937 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.879938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.879948 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.880005 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:36.881083 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.881577 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.882947 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.883229 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.883307 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.885392 (+ 2085us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:36.885394 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:36.885394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:36.885407 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:36.886881 (+ 1474us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.887302 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.887303 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.887304 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.887372 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.887626 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.887627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.887627 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.887751 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:36.887828 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.888092 (+ 264us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.888172 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:11:36.888491 16539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.879179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44281 (local address 127.29.69.131:47775)
0806 15:11:36.879331 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.879390 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.879855 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.880143 (+ 288us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.880148 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.880818 (+ 670us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:36.881008 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.881012 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.881673 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.881674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.882858 (+ 1184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.882861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.883314 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.883315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.883458 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.883896 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:36.883904 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:36.885265 (+ 1361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:36.886975 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:36.886982 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:36.886984 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:36.887204 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:36.887442 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:36.887443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:36.887444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:36.887553 (+ 109us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:36.887820 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:36.887827 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:36.887960 (+ 133us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.888070 (+ 110us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.888226 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":86,"threads_started":1}
I20260806 15:11:36.888929 16537 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44281
I20260806 15:11:36.889008 16537 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:36.889192 16537 heartbeater.cc:511] Master 127.29.69.190:44281 requested a full tablet report, sending...
I20260806 15:11:36.889564 16071 ts_manager.cc:194] Registered new tserver with Master: 3ce8bda5a43c475aad63b8a19229797c (127.29.69.131:32915)
I20260806 15:11:36.889931 16071 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:47775
I20260806 15:11:36.893886 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:11:36.901299 16115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.895258 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33664 (local address 127.29.69.190:44281)
0806 15:11:36.895335 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.895337 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.895467 (+ 130us) server_negotiation.cc:407] Connection header received
0806 15:11:36.895495 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.895495 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.895503 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.895551 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:36.896056 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.896497 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.897180 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.897376 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.897435 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.898757 (+ 1322us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:36.898758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:36.898758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:36.898764 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:36.900226 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.900619 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.900619 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.900620 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.900669 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:36.900883 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:36.900884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:36.900884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:36.901005 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:36.901081 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.901195 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.901240 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260806 15:11:36.902992 16071 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33664:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:11:36.904572 16071 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:11:36.911175 16548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.906998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40911 (local address 127.0.0.1:52192)
0806 15:11:36.907242 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.907251 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.907291 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.907618 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.907619 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.907622 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:36.907687 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.907689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.908678 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.908680 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.909913 (+ 1233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.909916 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.910867 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.910949 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.910976 (+ 27us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.911046 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.911104 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"thread_start_us":101,"threads_started":1}
I20260806 15:11:36.911212 16553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.907277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52192 (local address 127.29.69.130:40911)
0806 15:11:36.907453 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.907458 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.907484 (+ 26us) server_negotiation.cc:407] Connection header received
0806 15:11:36.907523 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.907525 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.907538 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.907606 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:36.907742 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.908574 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910023 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.910776 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910860 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.910927 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.911074 (+ 147us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.911129 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":103,"threads_started":1}
I20260806 15:11:36.911487 16552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.906807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:32915 (local address 127.0.0.1:51846)
0806 15:11:36.907153 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.907193 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.907273 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.907509 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.907512 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.907514 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:36.907590 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.907592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.908998 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.908999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.910038 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.910040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.910963 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.911058 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.911062 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.911115 (+ 53us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.911154 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":49,"threads_started":1}
I20260806 15:11:36.911517 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.906885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51846 (local address 127.29.69.131:32915)
0806 15:11:36.907059 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.907064 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.907359 (+ 295us) server_negotiation.cc:407] Connection header received
0806 15:11:36.907404 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.907407 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.907423 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.907503 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:36.907677 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.908892 (+ 1215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910118 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.910811 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910870 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.910927 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.911219 (+ 292us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.911433 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":91,"threads_started":1}
I20260806 15:11:36.911938 16334 tablet_service.cc:1467] Processing CreateTablet for tablet abf9298d1da54512b94284510ff07db7 (DEFAULT_TABLE table=test-table [id=6b740e85cf6b41e185eb9f2a6ddcac37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:36.912142 16470 tablet_service.cc:1467] Processing CreateTablet for tablet abf9298d1da54512b94284510ff07db7 (DEFAULT_TABLE table=test-table [id=6b740e85cf6b41e185eb9f2a6ddcac37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:36.912304 16334 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf9298d1da54512b94284510ff07db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:36.912442 16470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf9298d1da54512b94284510ff07db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:36.912540 16551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.906939 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38208 (local address 127.29.69.129:39699)
0806 15:11:36.907123 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.907126 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.907286 (+ 160us) server_negotiation.cc:407] Connection header received
0806 15:11:36.907416 (+ 130us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.907418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.907435 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.907486 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:36.907716 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.908890 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.911008 (+ 2118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.911949 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.912050 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.912108 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.912390 (+ 282us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.912437 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":83,"threads_started":1}
I20260806 15:11:36.912729 16549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.906815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:39699 (local address 127.0.0.1:38208)
0806 15:11:36.907173 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.907220 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.907318 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.907597 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.907597 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.907600 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:36.907643 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.907644 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.910133 (+ 2489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.910134 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.910909 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.910911 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.912054 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.912056 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.912217 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.912221 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.912336 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.912663 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":342,"thread_start_us":90,"threads_started":1}
I20260806 15:11:36.915745 16554 tablet_bootstrap.cc:492] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Bootstrap starting.
I20260806 15:11:36.915915 16555 tablet_bootstrap.cc:492] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Bootstrap starting.
I20260806 15:11:36.916383 16199 tablet_service.cc:1467] Processing CreateTablet for tablet abf9298d1da54512b94284510ff07db7 (DEFAULT_TABLE table=test-table [id=6b740e85cf6b41e185eb9f2a6ddcac37]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:36.916587 16555 tablet_bootstrap.cc:654] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:36.916587 16554 tablet_bootstrap.cc:654] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:36.916697 16199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet abf9298d1da54512b94284510ff07db7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:36.917237 16555 log.cc:824] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:36.917237 16554 log.cc:824] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:36.918000 16554 tablet_bootstrap.cc:492] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: No bootstrap required, opened a new log
I20260806 15:11:36.918037 16555 tablet_bootstrap.cc:492] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: No bootstrap required, opened a new log
I20260806 15:11:36.918090 16554 ts_tablet_manager.cc:1397] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:36.918098 16555 ts_tablet_manager.cc:1397] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:36.919529 16554 raft_consensus.cc:348] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.919699 16554 raft_consensus.cc:374] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:36.919746 16554 raft_consensus.cc:729] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ce8bda5a43c475aad63b8a19229797c, State: Initialized, Role: FOLLOWER
I20260806 15:11:36.919905 16554 consensus_queue.cc:260] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.919983 16558 tablet_bootstrap.cc:492] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc: Bootstrap starting.
I20260806 15:11:36.920197 16554 ts_tablet_manager.cc:1428] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:36.920162 16555 raft_consensus.cc:348] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.920318 16537 heartbeater.cc:503] Master 127.29.69.190:44281 was elected leader, sending a full tablet report...
I20260806 15:11:36.920347 16555 raft_consensus.cc:374] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:36.920395 16555 raft_consensus.cc:729] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a629233b4f34bf0a8ebb7c2201657ac, State: Initialized, Role: FOLLOWER
I20260806 15:11:36.920511 16555 consensus_queue.cc:260] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.920783 16555 ts_tablet_manager.cc:1428] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:36.920814 16401 heartbeater.cc:503] Master 127.29.69.190:44281 was elected leader, sending a full tablet report...
I20260806 15:11:36.920885 16558 tablet_bootstrap.cc:654] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:36.921458 16558 log.cc:824] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:36.922122 16558 tablet_bootstrap.cc:492] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc: No bootstrap required, opened a new log
I20260806 15:11:36.922175 16558 ts_tablet_manager.cc:1397] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:36.923863 16558 raft_consensus.cc:348] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.923993 16558 raft_consensus.cc:374] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:36.924016 16558 raft_consensus.cc:729] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8f886ba8e84449699b38250d6ca42cc, State: Initialized, Role: FOLLOWER
I20260806 15:11:36.924090 16558 consensus_queue.cc:260] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.924280 16558 ts_tablet_manager.cc:1428] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:36.924340 16265 heartbeater.cc:503] Master 127.29.69.190:44281 was elected leader, sending a full tablet report...
I20260806 15:11:36.926172 16559 raft_consensus.cc:482] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:36.926236 16559 raft_consensus.cc:504] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.926589 16559 leader_election.cc:288] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8f886ba8e84449699b38250d6ca42cc (127.29.69.129:39699), 2a629233b4f34bf0a8ebb7c2201657ac (127.29.69.130:40911)
I20260806 15:11:36.929463 16539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.926711 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:39699 (local address 127.29.69.131:48735)
0806 15:11:36.926752 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.926764 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.926805 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.926946 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.926948 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.926949 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:36.927010 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.927012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.927733 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.927734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.928600 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.928603 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.929286 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.929287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.929344 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.929347 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.929389 (+ 42us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.929419 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260806 15:11:36.929533 16551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.926806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:48735 (local address 127.29.69.129:39699)
0806 15:11:36.926846 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.926848 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.926855 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:11:36.926876 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.926879 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.926892 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.926939 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:36.927083 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.927647 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.928697 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.929212 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.929284 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.929292 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.929411 (+ 119us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.929447 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:11:36.929873 16563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.926716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:40911 (local address 127.29.69.131:33085)
0806 15:11:36.927011 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.927020 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:36.927095 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:36.927197 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:36.927198 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:36.927199 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:36.927270 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.927272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.928083 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.928083 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.928816 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:36.928818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.929633 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.929634 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:36.929707 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.929710 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:36.929764 (+ 54us) client_negotiation.cc:240] Negotiation successful
0806 15:11:36.929801 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"mutex_wait_us":21,"thread_start_us":88,"threads_started":1}
I20260806 15:11:36.929888 16553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.926878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:33085 (local address 127.29.69.130:40911)
0806 15:11:36.926916 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.926918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.927105 (+ 187us) server_negotiation.cc:407] Connection header received
0806 15:11:36.927144 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.927144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.927150 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.927186 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:36.927343 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.927993 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.928893 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.929474 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.929542 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.929551 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.929782 (+ 231us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.929818 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:11:36.929883 16219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9298d1da54512b94284510ff07db7" candidate_uuid: "3ce8bda5a43c475aad63b8a19229797c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f886ba8e84449699b38250d6ca42cc" is_pre_election: true
I20260806 15:11:36.930032 16219 raft_consensus.cc:2454] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce8bda5a43c475aad63b8a19229797c in term 0.
I20260806 15:11:36.930145 16355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9298d1da54512b94284510ff07db7" candidate_uuid: "3ce8bda5a43c475aad63b8a19229797c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" is_pre_election: true
I20260806 15:11:36.930280 16355 raft_consensus.cc:2454] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3ce8bda5a43c475aad63b8a19229797c in term 0.
I20260806 15:11:36.930259 16426 leader_election.cc:302] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3ce8bda5a43c475aad63b8a19229797c, c8f886ba8e84449699b38250d6ca42cc; no voters:
I20260806 15:11:36.930416 16559 raft_consensus.cc:2781] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:11:36.930475 16559 raft_consensus.cc:482] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:11:36.930502 16559 raft_consensus.cc:3037] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:36.931085 16559 raft_consensus.cc:504] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.931218 16559 leader_election.cc:288] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [CANDIDATE]: Term 1 election: Requested vote from peers c8f886ba8e84449699b38250d6ca42cc (127.29.69.129:39699), 2a629233b4f34bf0a8ebb7c2201657ac (127.29.69.130:40911)
I20260806 15:11:36.931358 16219 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9298d1da54512b94284510ff07db7" candidate_uuid: "3ce8bda5a43c475aad63b8a19229797c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8f886ba8e84449699b38250d6ca42cc"
I20260806 15:11:36.931392 16355 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abf9298d1da54512b94284510ff07db7" candidate_uuid: "3ce8bda5a43c475aad63b8a19229797c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a629233b4f34bf0a8ebb7c2201657ac"
I20260806 15:11:36.931442 16219 raft_consensus.cc:3037] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:36.931448 16355 raft_consensus.cc:3037] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:36.932232 16219 raft_consensus.cc:2454] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce8bda5a43c475aad63b8a19229797c in term 1.
I20260806 15:11:36.932305 16355 raft_consensus.cc:2454] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3ce8bda5a43c475aad63b8a19229797c in term 1.
I20260806 15:11:36.932478 16424 leader_election.cc:302] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a629233b4f34bf0a8ebb7c2201657ac, 3ce8bda5a43c475aad63b8a19229797c; no voters:
I20260806 15:11:36.932566 16559 raft_consensus.cc:2781] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:36.932708 16559 raft_consensus.cc:686] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 1 LEADER]: Becoming Leader. State: Replica: 3ce8bda5a43c475aad63b8a19229797c, State: Running, Role: LEADER
I20260806 15:11:36.932796 16559 consensus_queue.cc:237] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } }
I20260806 15:11:36.933560 16071 catalog_manager.cc:5495] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c reported cstate change: term changed from 0 to 1, leader changed from <none> to 3ce8bda5a43c475aad63b8a19229797c (127.29.69.131). New cstate: current_term: 1 leader_uuid: "3ce8bda5a43c475aad63b8a19229797c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3ce8bda5a43c475aad63b8a19229797c" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 32915 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 } health_report { overall_health: UNKNOWN } } }
I20260806 15:11:36.943837 16550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.941409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51856 (local address 127.29.69.131:32915)
0806 15:11:36.941467 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:36.941469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:36.941480 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:11:36.941523 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:36.941524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:36.941540 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:36.941622 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:11:36.941758 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.942278 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.943077 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:36.943264 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:36.943336 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:36.943499 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:11:36.943588 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:11:36.943701 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:36.943731 (+ 30us) server_negotiation.cc:299] Negotiation successful
0806 15:11:36.943742 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 15:11:36.945451 16355 raft_consensus.cc:1261] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 1 FOLLOWER]: Refusing update from remote peer 3ce8bda5a43c475aad63b8a19229797c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:36.945452 16219 raft_consensus.cc:1261] T abf9298d1da54512b94284510ff07db7 P c8f886ba8e84449699b38250d6ca42cc [term 1 FOLLOWER]: Refusing update from remote peer 3ce8bda5a43c475aad63b8a19229797c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:36.945780 16559 consensus_queue.cc:1035] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a629233b4f34bf0a8ebb7c2201657ac" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 40911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:36.945924 16564 consensus_queue.cc:1035] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8f886ba8e84449699b38250d6ca42cc" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 39699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:36.948354 16567 mvcc.cc:205] Tried to move back new op lower bound from 7315575181086154752 to 7315575181037416448. Current Snapshot: MvccSnapshot[applied={T|T < 7315575181086154752}]
I20260806 15:11:36.948777 16569 mvcc.cc:205] Tried to move back new op lower bound from 7315575181086154752 to 7315575181037416448. Current Snapshot: MvccSnapshot[applied={T|T < 7315575181086154752}]
I20260806 15:11:36.950536 16071 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:36.950645 16071 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33664:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:36.951388 16071 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1fbbf6bf09634e8496031a969516942a: Sending DeleteTablet for 3 replicas of tablet abf9298d1da54512b94284510ff07db7
I20260806 15:11:36.951721 16199 tablet_service.cc:1514] Processing DeleteTablet for tablet abf9298d1da54512b94284510ff07db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:38208
I20260806 15:11:36.951730 16334 tablet_service.cc:1514] Processing DeleteTablet for tablet abf9298d1da54512b94284510ff07db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:52192
I20260806 15:11:36.951988 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16133
I20260806 15:11:36.952023 16470 tablet_service.cc:1514] Processing DeleteTablet for tablet abf9298d1da54512b94284510ff07db7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:36 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:51846
I20260806 15:11:36.955724 16578 tablet_replica.cc:330] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: stopping tablet replica
I20260806 15:11:36.955833 16578 raft_consensus.cc:2229] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:36.955937 16578 raft_consensus.cc:2258] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:36.956099 16579 tablet_replica.cc:330] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: stopping tablet replica
I20260806 15:11:36.956192 16579 raft_consensus.cc:2229] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:11:36.956300 16579 raft_consensus.cc:2258] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:36.956415 16578 ts_tablet_manager.cc:1905] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:36.956825 16579 ts_tablet_manager.cc:1905] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:36.958171 16578 ts_tablet_manager.cc:1918] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:36.958251 16578 log.cc:1196] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/abf9298d1da54512b94284510ff07db7
I20260806 15:11:36.958573 16578 ts_tablet_manager.cc:1939] T abf9298d1da54512b94284510ff07db7 P 2a629233b4f34bf0a8ebb7c2201657ac: Deleting consensus metadata
I20260806 15:11:36.958972 16056 catalog_manager.cc:4841] TS 2a629233b4f34bf0a8ebb7c2201657ac (127.29.69.130:40911): tablet abf9298d1da54512b94284510ff07db7 (table test-table [id=6b740e85cf6b41e185eb9f2a6ddcac37]) successfully deleted
I20260806 15:11:36.958997 16579 ts_tablet_manager.cc:1918] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:36.959139 16579 log.cc:1196] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/abf9298d1da54512b94284510ff07db7
I20260806 15:11:36.959410 16579 ts_tablet_manager.cc:1939] T abf9298d1da54512b94284510ff07db7 P 3ce8bda5a43c475aad63b8a19229797c: Deleting consensus metadata
I20260806 15:11:36.959789 16056 catalog_manager.cc:4841] TS 3ce8bda5a43c475aad63b8a19229797c (127.29.69.131:32915): tablet abf9298d1da54512b94284510ff07db7 (table test-table [id=6b740e85cf6b41e185eb9f2a6ddcac37]) successfully deleted
W20260806 15:11:36.960739 16058 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:39699 (error 108)
I20260806 15:11:36.961192 16549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:36.961082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:39699 (local address 127.0.0.1:38210)
0806 15:11:36.961129 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:36.961160 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:39699: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 15:11:36.961241 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16271
W20260806 15:11:36.961301 16058 catalog_manager.cc:4584] TS c8f886ba8e84449699b38250d6ca42cc (127.29.69.129:39699): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet abf9298d1da54512b94284510ff07db7: Network error: Client connection negotiation failed: client connection to 127.29.69.129:39699: connect: Connection refused (error 111)
I20260806 15:11:36.966996 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16406
I20260806 15:11:36.972745 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16039
2026-08-06T15:11:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (1923 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-06T15:11:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:36Z Disabled control of system clock
I20260806 15:11:37.001042 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:44913
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:33541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:44913
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:37.081233 16584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:37.081439 16584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:37.081460 16584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:37.082657 16584 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:37.082696 16584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:37.082710 16584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:37.082723 16584 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:37.082736 16584 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:37.084079 16584 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:44913
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:44913
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:37.084337 16584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:37.084635 16584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:37.089422 16590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.089437 16589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.089437 16592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:37.089761 16584 server_base.cc:1034] running on GCE node
I20260806 15:11:37.090049 16584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:37.090376 16584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:37.091552 16584 hybrid_clock.cc:648] HybridClock initialized: now 1786029097091549 us; error 42 us; skew 500 ppm
I20260806 15:11:37.092806 16584 webserver.cc:460] Webserver started at http://127.29.69.190:35793/ using document root <none> and password file <none>
I20260806 15:11:37.093060 16584 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:37.093129 16584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:37.093267 16584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:37.094504 16584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "55ce02919bfa40bca64b1e1b5143aba3"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "38969a0f1a5a18e0663fadc4c1998a5a"
server_key_iv: "d32a6cd9ea4f1111adf5abf3f73ceaba"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.094863 16584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "55ce02919bfa40bca64b1e1b5143aba3"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "38969a0f1a5a18e0663fadc4c1998a5a"
server_key_iv: "d32a6cd9ea4f1111adf5abf3f73ceaba"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.096165 16584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:11:37.096935 16598 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.097157 16584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:37.097275 16584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "55ce02919bfa40bca64b1e1b5143aba3"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "38969a0f1a5a18e0663fadc4c1998a5a"
server_key_iv: "d32a6cd9ea4f1111adf5abf3f73ceaba"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.097378 16584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:37.127393 16584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:37.127683 16584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:37.127847 16584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:37.132009 16584 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:44913
I20260806 15:11:37.132042 16651 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:44913 every 8 connection(s)
I20260806 15:11:37.132400 16584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:37.133384 16652 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:37.135694 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16584
I20260806 15:11:37.135815 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:37.136009 29974 external_mini_cluster.cc:1428] Setting key 12bcb025307032ca4c1587eeebb3a070
I20260806 15:11:37.135990 16652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3: Bootstrap starting.
I20260806 15:11:37.136823 16652 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:37.137161 16652 log.cc:824] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:37.138024 16652 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3: No bootstrap required, opened a new log
I20260806 15:11:37.140280 16652 raft_consensus.cc:348] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ce02919bfa40bca64b1e1b5143aba3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44913 } }
I20260806 15:11:37.140444 16652 raft_consensus.cc:374] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:37.140480 16652 raft_consensus.cc:729] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55ce02919bfa40bca64b1e1b5143aba3, State: Initialized, Role: FOLLOWER
I20260806 15:11:37.140609 16652 consensus_queue.cc:260] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ce02919bfa40bca64b1e1b5143aba3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44913 } }
I20260806 15:11:37.140702 16652 raft_consensus.cc:388] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:37.140734 16652 raft_consensus.cc:482] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:37.140825 16652 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:37.141587 16652 raft_consensus.cc:504] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ce02919bfa40bca64b1e1b5143aba3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44913 } }
I20260806 15:11:37.141705 16652 leader_election.cc:302] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55ce02919bfa40bca64b1e1b5143aba3; no voters:
I20260806 15:11:37.141894 16652 leader_election.cc:288] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:37.141953 16657 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:37.142127 16657 raft_consensus.cc:686] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [term 1 LEADER]: Becoming Leader. State: Replica: 55ce02919bfa40bca64b1e1b5143aba3, State: Running, Role: LEADER
I20260806 15:11:37.142196 16652 sys_catalog.cc:564] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:37.142179 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.136552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40204 (local address 127.29.69.190:44913)
0806 15:11:37.136770 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.136777 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.136800 (+ 23us) server_negotiation.cc:407] Connection header received
0806 15:11:37.137298 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.137305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.137378 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.137494 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:37.137768 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.139218 (+ 1450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.139972 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.140604 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.140728 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.141470 (+ 742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:37.141474 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:37.141474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:37.141684 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:37.141727 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:37.141741 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:37.141812 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.141900 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.141982 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260806 15:11:37.142280 16657 consensus_queue.cc:237] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ce02919bfa40bca64b1e1b5143aba3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44913 } }
I20260806 15:11:37.142952 16658 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55ce02919bfa40bca64b1e1b5143aba3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ce02919bfa40bca64b1e1b5143aba3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44913 } } }
I20260806 15:11:37.143035 16658 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:37.143254 16659 sys_catalog.cc:455] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55ce02919bfa40bca64b1e1b5143aba3. Latest consensus state: current_term: 1 leader_uuid: "55ce02919bfa40bca64b1e1b5143aba3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55ce02919bfa40bca64b1e1b5143aba3" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 44913 } } }
I20260806 15:11:37.143378 16659 sys_catalog.cc:458] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:37.143569 16666 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:37.144109 16666 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:37.145560 16666 catalog_manager.cc:1347] Generated new cluster ID: 285c6008af3a4b0584f7f2204d2cedf0
I20260806 15:11:37.145613 16666 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:37.155879 16666 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:37.156406 16666 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:37.160498 16666 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3: Generated new TSK 0
I20260806 15:11:37.160687 16666 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:37.166642 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44913
--builtin_ntp_servers=127.29.69.148:33541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:37.248744 16676 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:37.248975 16676 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:37.249011 16676 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:37.250183 16676 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:37.250249 16676 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:37.250293 16676 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:37.251765 16676 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16676
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:37.252038 16676 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:37.252338 16676 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:37.258144 16681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.258167 16682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.258167 16684 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:37.258625 16676 server_base.cc:1034] running on GCE node
I20260806 15:11:37.258817 16676 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:37.259047 16676 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:37.260215 16676 hybrid_clock.cc:648] HybridClock initialized: now 1786029097260194 us; error 38 us; skew 500 ppm
I20260806 15:11:37.261595 16676 webserver.cc:460] Webserver started at http://127.29.69.129:46179/ using document root <none> and password file <none>
I20260806 15:11:37.261850 16676 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:37.261924 16676 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:37.262071 16676 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:37.263183 16676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "da5e9929e3d647dd96852db0b2127f57"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "ed179a7f878a8b64775873ade7669f51"
server_key_iv: "eeffbb8d14a0dfab7690d58dcbd60cfd"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.263548 16676 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "da5e9929e3d647dd96852db0b2127f57"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "ed179a7f878a8b64775873ade7669f51"
server_key_iv: "eeffbb8d14a0dfab7690d58dcbd60cfd"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.264914 16676 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:11:37.265784 16690 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.265988 16676 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:37.266091 16676 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "da5e9929e3d647dd96852db0b2127f57"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "ed179a7f878a8b64775873ade7669f51"
server_key_iv: "eeffbb8d14a0dfab7690d58dcbd60cfd"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.266180 16676 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:37.287045 16676 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:37.287375 16676 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:37.287539 16676 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:37.287792 16676 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:37.288143 16676 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:37.288200 16676 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.288249 16676 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:37.288272 16676 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.294443 16676 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:44019
I20260806 15:11:37.294555 16805 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:44019 every 8 connection(s)
I20260806 15:11:37.294866 16676 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:37.300169 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.295662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:37281 (local address 127.29.69.190:44913)
0806 15:11:37.295764 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.295767 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.295920 (+ 153us) server_negotiation.cc:407] Connection header received
0806 15:11:37.296443 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.296444 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.296457 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.296535 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:37.297207 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.297741 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.298751 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.298942 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.299003 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.299884 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:37.299885 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:37.299885 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:37.299889 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:37.299903 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:37.299907 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:37.299992 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.300087 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.300109 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260806 15:11:37.300395 16808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.295592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44913 (local address 127.29.69.129:37281)
0806 15:11:37.295799 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.295835 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.296333 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.296607 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.296610 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.296618 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:37.297116 (+ 498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.297120 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.297846 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.297847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.298673 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.298675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.299028 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.299029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.299136 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.299720 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:37.299720 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:37.299749 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:37.299793 (+ 44us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:37.300002 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:37.300009 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:37.300012 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.300078 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.300170 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":75,"threads_started":1}
I20260806 15:11:37.300971 16806 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44913
I20260806 15:11:37.301081 16806 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:37.301265 16806 heartbeater.cc:511] Master 127.29.69.190:44913 requested a full tablet report, sending...
I20260806 15:11:37.301764 16615 ts_manager.cc:194] Registered new tserver with Master: da5e9929e3d647dd96852db0b2127f57 (127.29.69.129:44019)
I20260806 15:11:37.301860 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16676
I20260806 15:11:37.301990 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:11:37.302177 29974 external_mini_cluster.cc:1428] Setting key c73db055ada0a14e5d725987cd4cb57b
I20260806 15:11:37.302822 16615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.129:37281
I20260806 15:11:37.303304 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44913
--builtin_ntp_servers=127.29.69.148:33541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:37.385632 16809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:37.385823 16809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:37.385844 16809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:37.387013 16809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:37.387051 16809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:37.387076 16809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:37.388338 16809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16809
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:37.388518 16809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:37.388760 16809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:37.393682 16814 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.393819 16815 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.393682 16817 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:37.393924 16809 server_base.cc:1034] running on GCE node
I20260806 15:11:37.394150 16809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:37.394394 16809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:37.395593 16809 hybrid_clock.cc:648] HybridClock initialized: now 1786029097395578 us; error 28 us; skew 500 ppm
I20260806 15:11:37.396790 16809 webserver.cc:460] Webserver started at http://127.29.69.130:43113/ using document root <none> and password file <none>
I20260806 15:11:37.397055 16809 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:37.397125 16809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:37.397282 16809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:37.398388 16809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "89c2086a0217450bb734c8567aee92f2"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "b4c988065b944a9d85b25cefaa69134f"
server_key_iv: "5d4fd00645419d98b156af307fd1b602"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.398749 16809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "89c2086a0217450bb734c8567aee92f2"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "b4c988065b944a9d85b25cefaa69134f"
server_key_iv: "5d4fd00645419d98b156af307fd1b602"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.400086 16809 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:37.400830 16823 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.401005 16809 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:37.401108 16809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "89c2086a0217450bb734c8567aee92f2"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "b4c988065b944a9d85b25cefaa69134f"
server_key_iv: "5d4fd00645419d98b156af307fd1b602"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.401180 16809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:37.416790 16809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:37.417084 16809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:37.417236 16809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:37.417451 16809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:37.417778 16809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:37.417832 16809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.417866 16809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:37.417896 16809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.423547 16809 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:43967
I20260806 15:11:37.423585 16938 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:43967 every 8 connection(s)
I20260806 15:11:37.423925 16809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:37.428158 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16809
I20260806 15:11:37.428272 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:11:37.428475 29974 external_mini_cluster.cc:1428] Setting key 9ee3a22c71be60b7af9876c580433965
I20260806 15:11:37.428972 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.424675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:36483 (local address 127.29.69.190:44913)
0806 15:11:37.424738 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.424740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.424985 (+ 245us) server_negotiation.cc:407] Connection header received
0806 15:11:37.425455 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.425456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.425465 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.425518 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:37.426132 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.426678 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.427614 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.427794 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.427842 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.428690 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:37.428692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:37.428692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:37.428698 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:37.428715 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:37.428723 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:37.428786 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.428886 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.428914 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260806 15:11:37.429214 16941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.424662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44913 (local address 127.29.69.130:36483)
0806 15:11:37.424859 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.424899 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.425375 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.425576 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.425579 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.425587 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:37.426065 (+ 478us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.426069 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.426760 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.426761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.427539 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.427541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.427867 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.427868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.427971 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.428529 (+ 558us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:37.428529 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:37.428557 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:37.428596 (+ 39us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:37.428800 (+ 204us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:37.428806 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:37.428808 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.428872 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.428973 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260806 15:11:37.429553 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44913
--builtin_ntp_servers=127.29.69.148:33541
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 15:11:37.429702 16939 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44913
I20260806 15:11:37.429777 16939 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:37.429948 16939 heartbeater.cc:511] Master 127.29.69.190:44913 requested a full tablet report, sending...
I20260806 15:11:37.430368 16615 ts_manager.cc:194] Registered new tserver with Master: 89c2086a0217450bb734c8567aee92f2 (127.29.69.130:43967)
I20260806 15:11:37.430867 16615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.130:36483
W20260806 15:11:37.510280 16942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:37.510524 16942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:37.510560 16942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:37.511684 16942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:37.511749 16942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:37.511790 16942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:37.513162 16942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33541
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:44913
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:37.513427 16942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:37.513720 16942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260806 15:11:37.518853 16942 server_base.cc:1034] running on GCE node
W20260806 15:11:37.518810 16948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.518808 16947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:37.518814 16950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:37.519263 16942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:37.519511 16942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:37.520656 16942 hybrid_clock.cc:648] HybridClock initialized: now 1786029097520632 us; error 41 us; skew 500 ppm
I20260806 15:11:37.521826 16942 webserver.cc:460] Webserver started at http://127.29.69.131:38943/ using document root <none> and password file <none>
I20260806 15:11:37.522090 16942 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:37.522162 16942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:37.522349 16942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:37.523377 16942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "48a9f7420d8741869ddd288ae0ab6eda"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "8525cb83b864785c5929b51f348e2d5f"
server_key_iv: "6ce4b699314ee564964fa2a5c5bb0274"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.523746 16942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "48a9f7420d8741869ddd288ae0ab6eda"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "8525cb83b864785c5929b51f348e2d5f"
server_key_iv: "6ce4b699314ee564964fa2a5c5bb0274"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.524987 16942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:37.525691 16956 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.525864 16942 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:37.525972 16942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "48a9f7420d8741869ddd288ae0ab6eda"
format_stamp: "Formatted at 2026-08-06 15:11:37 on dist-test-slave-tm1g"
server_key: "8525cb83b864785c5929b51f348e2d5f"
server_key_iv: "6ce4b699314ee564964fa2a5c5bb0274"
server_key_version: "encryptionkey@0"
I20260806 15:11:37.526052 16942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:37.536131 16942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:37.536403 16942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:37.536547 16942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:37.536755 16942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:37.537061 16942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:37.537117 16942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.537156 16942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:37.537184 16942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:37.543182 16942 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:38511
I20260806 15:11:37.543229 17072 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:38511 every 8 connection(s)
I20260806 15:11:37.543591 16942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:11:37.544458 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 16942
I20260806 15:11:37.544575 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:11:37.544772 29974 external_mini_cluster.cc:1428] Setting key af0fe1a9924e527673039f351ea40775
I20260806 15:11:37.549003 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.544257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:60365 (local address 127.29.69.190:44913)
0806 15:11:37.544331 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.544333 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.544554 (+ 221us) server_negotiation.cc:407] Connection header received
0806 15:11:37.545210 (+ 656us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.545211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.545225 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.545281 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:37.546102 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.546703 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.547685 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.547887 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.547966 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.548717 (+ 751us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:37.548719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:37.548719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:37.548723 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:37.548739 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:37.548743 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:37.548796 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.548895 (+ 99us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.548923 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260806 15:11:37.549226 17076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.544268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:44913 (local address 127.29.69.131:60365)
0806 15:11:37.544435 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.544467 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.545110 (+ 643us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.545371 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.545375 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.545386 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:37.546007 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.546013 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.546801 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.546802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.547591 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.547593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.547983 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.547985 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.548121 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.548580 (+ 459us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:37.548580 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:37.548607 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:37.548629 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:37.548801 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:37.548806 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:37.548809 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.548896 (+ 87us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.549007 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":89,"threads_started":1}
I20260806 15:11:37.549695 17073 heartbeater.cc:347] Connected to a master server at 127.29.69.190:44913
I20260806 15:11:37.549799 17073 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:37.549980 17073 heartbeater.cc:511] Master 127.29.69.190:44913 requested a full tablet report, sending...
I20260806 15:11:37.550432 16615 ts_manager.cc:194] Registered new tserver with Master: 48a9f7420d8741869ddd288ae0ab6eda (127.29.69.131:38511)
I20260806 15:11:37.550824 16615 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.131:60365
I20260806 15:11:37.556660 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:11:37.561046 16655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.558055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40218 (local address 127.29.69.190:44913)
0806 15:11:37.558138 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.558140 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.558257 (+ 117us) server_negotiation.cc:407] Connection header received
0806 15:11:37.558336 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.558337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.558348 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.558405 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:37.558596 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.559070 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.559824 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.560016 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.560092 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.560749 (+ 657us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:37.560750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:37.560750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:37.560754 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:37.560769 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:37.560779 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:37.560874 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.560945 (+ 71us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.560955 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 15:11:37.562804 16615 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40218:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:11:37.564363 16615 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:11:37.571139 17087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.567082 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33804 (local address 127.29.69.129:44019)
0806 15:11:37.567258 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.567262 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.567507 (+ 245us) server_negotiation.cc:407] Connection header received
0806 15:11:37.567552 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.567554 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.567568 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.567643 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:37.567823 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.568651 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570167 (+ 1516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.570734 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570818 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.570915 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.571011 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.571050 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":89,"threads_started":1}
I20260806 15:11:37.571130 17083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.566799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44019 (local address 127.0.0.1:33804)
0806 15:11:37.567389 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.567396 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.567450 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.567718 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.567719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.567721 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:37.567757 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.567758 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.568735 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.568736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.570096 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.570099 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.570831 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570832 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.570909 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.570923 (+ 14us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.570996 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.571058 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":2,"thread_start_us":133,"threads_started":1}
I20260806 15:11:37.571231 17082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.566778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38511 (local address 127.0.0.1:45694)
0806 15:11:37.566965 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.567001 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.567068 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.567512 (+ 444us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.567515 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.567517 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:37.567602 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.567604 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.568995 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.568996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.570121 (+ 1125us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.570123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.571043 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.571043 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.571101 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.571103 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.571131 (+ 28us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.571163 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":46,"thread_start_us":106,"threads_started":1}
I20260806 15:11:37.571310 17086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.566975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44406 (local address 127.29.69.130:43967)
0806 15:11:37.567198 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.567204 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.567346 (+ 142us) server_negotiation.cc:407] Connection header received
0806 15:11:37.567399 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.567401 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.567418 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.567490 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:37.567700 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.568894 (+ 1194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570017 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.570765 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570836 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.570921 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.571175 (+ 254us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.571215 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":107,"threads_started":1}
I20260806 15:11:37.571481 17084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.566778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:43967 (local address 127.0.0.1:44406)
0806 15:11:37.567258 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.567268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.567322 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.567565 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.567565 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.567568 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:37.567618 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.567619 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.568977 (+ 1358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.568978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.569925 (+ 947us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.569927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.570961 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570963 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.571031 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.571036 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.571085 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.571133 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":463,"mutex_wait_us":5,"thread_start_us":78,"threads_started":1}
I20260806 15:11:37.571612 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.566967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45694 (local address 127.29.69.131:38511)
0806 15:11:37.567266 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.567270 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.567279 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:37.567333 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.567335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.567351 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.567446 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:37.567750 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.568867 (+ 1117us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.570207 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.570953 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.571336 (+ 383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.571434 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.571459 (+ 25us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.571497 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":269,"thread_start_us":77,"threads_started":1}
I20260806 15:11:37.572211 16872 tablet_service.cc:1467] Processing CreateTablet for tablet c6c55f2327d44ea6bd77946f28315ba2 (DEFAULT_TABLE table=test-table [id=73a2c54333884da8943e90960d0309cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:37.572202 17004 tablet_service.cc:1467] Processing CreateTablet for tablet c6c55f2327d44ea6bd77946f28315ba2 (DEFAULT_TABLE table=test-table [id=73a2c54333884da8943e90960d0309cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:37.572376 16738 tablet_service.cc:1467] Processing CreateTablet for tablet c6c55f2327d44ea6bd77946f28315ba2 (DEFAULT_TABLE table=test-table [id=73a2c54333884da8943e90960d0309cb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:37.572574 17004 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c55f2327d44ea6bd77946f28315ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:37.572574 16872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c55f2327d44ea6bd77946f28315ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:37.572685 16738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6c55f2327d44ea6bd77946f28315ba2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:37.575412 17088 tablet_bootstrap.cc:492] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57: Bootstrap starting.
I20260806 15:11:37.575866 17090 tablet_bootstrap.cc:492] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Bootstrap starting.
I20260806 15:11:37.576078 17089 tablet_bootstrap.cc:492] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: Bootstrap starting.
I20260806 15:11:37.576150 17088 tablet_bootstrap.cc:654] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:37.576491 17088 log.cc:824] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:37.576764 17089 tablet_bootstrap.cc:654] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:37.577116 17089 log.cc:824] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:37.577301 17088 tablet_bootstrap.cc:492] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57: No bootstrap required, opened a new log
I20260806 15:11:37.577373 17088 ts_tablet_manager.cc:1397] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:37.577821 17089 tablet_bootstrap.cc:492] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: No bootstrap required, opened a new log
I20260806 15:11:37.577911 17089 ts_tablet_manager.cc:1397] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:37.577987 17090 tablet_bootstrap.cc:654] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:37.578382 17090 log.cc:824] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:37.579207 17090 tablet_bootstrap.cc:492] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: No bootstrap required, opened a new log
I20260806 15:11:37.579282 17090 ts_tablet_manager.cc:1397] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260806 15:11:37.579810 17088 raft_consensus.cc:348] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.579928 17088 raft_consensus.cc:374] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:37.579949 17088 raft_consensus.cc:729] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da5e9929e3d647dd96852db0b2127f57, State: Initialized, Role: FOLLOWER
I20260806 15:11:37.580078 17088 consensus_queue.cc:260] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.580345 16806 heartbeater.cc:503] Master 127.29.69.190:44913 was elected leader, sending a full tablet report...
I20260806 15:11:37.580328 17088 ts_tablet_manager.cc:1428] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:37.580610 17089 raft_consensus.cc:348] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.580757 17089 raft_consensus.cc:374] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:37.580790 17089 raft_consensus.cc:729] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89c2086a0217450bb734c8567aee92f2, State: Initialized, Role: FOLLOWER
I20260806 15:11:37.580926 17089 consensus_queue.cc:260] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.581184 17089 ts_tablet_manager.cc:1428] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:37.581305 16939 heartbeater.cc:503] Master 127.29.69.190:44913 was elected leader, sending a full tablet report...
I20260806 15:11:37.581786 17090 raft_consensus.cc:348] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.581960 17090 raft_consensus.cc:374] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:37.582010 17090 raft_consensus.cc:729] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48a9f7420d8741869ddd288ae0ab6eda, State: Initialized, Role: FOLLOWER
I20260806 15:11:37.582120 17090 consensus_queue.cc:260] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.582399 17090 ts_tablet_manager.cc:1428] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260806 15:11:37.582465 17073 heartbeater.cc:503] Master 127.29.69.190:44913 was elected leader, sending a full tablet report...
I20260806 15:11:37.606410 17095 raft_consensus.cc:482] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:37.606535 17095 raft_consensus.cc:504] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.606879 17095 leader_election.cc:288] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 48a9f7420d8741869ddd288ae0ab6eda (127.29.69.131:38511), da5e9929e3d647dd96852db0b2127f57 (127.29.69.129:44019)
I20260806 15:11:37.610900 16941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.607025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:38511 (local address 127.29.69.130:42343)
0806 15:11:37.607082 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.607094 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.607138 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.607349 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.607350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.607352 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:37.607450 (+ 98us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.607453 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.608400 (+ 947us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.608401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.609728 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.609731 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.610651 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.610652 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.610713 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.610717 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.610763 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.610802 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":30}
I20260806 15:11:37.610939 17085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.607081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:42343 (local address 127.29.69.131:38511)
0806 15:11:37.607138 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.607141 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.607150 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:37.607241 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.607244 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.607255 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.607338 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:37.607527 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.608317 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.609851 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.610521 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.610649 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.610658 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.610796 (+ 138us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.610858 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260806 15:11:37.611019 17087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.607137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:41765 (local address 127.29.69.129:44019)
0806 15:11:37.607185 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.607187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.607343 (+ 156us) server_negotiation.cc:407] Connection header received
0806 15:11:37.607377 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.607378 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.607397 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.607440 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:37.607614 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.608316 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.609851 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.610529 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.610611 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.610623 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.610886 (+ 263us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.610947 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:11:37.611038 17097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.607036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44019 (local address 127.29.69.130:41765)
0806 15:11:37.607233 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.607242 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:37.607295 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:37.607461 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:37.607461 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:37.607463 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:37.607539 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.607540 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.608400 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.608400 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.609727 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:37.609731 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.610666 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.610668 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:37.610794 (+ 126us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.610799 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:11:37.610863 (+ 64us) client_negotiation.cc:240] Negotiation successful
0806 15:11:37.610905 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":86,"thread_start_us":121,"threads_started":1}
I20260806 15:11:37.611384 16758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c55f2327d44ea6bd77946f28315ba2" candidate_uuid: "89c2086a0217450bb734c8567aee92f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da5e9929e3d647dd96852db0b2127f57" is_pre_election: true
I20260806 15:11:37.611572 16758 raft_consensus.cc:2454] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c2086a0217450bb734c8567aee92f2 in term 0.
I20260806 15:11:37.611574 17024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c55f2327d44ea6bd77946f28315ba2" candidate_uuid: "89c2086a0217450bb734c8567aee92f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a9f7420d8741869ddd288ae0ab6eda" is_pre_election: true
I20260806 15:11:37.611754 17024 raft_consensus.cc:2454] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89c2086a0217450bb734c8567aee92f2 in term 0.
I20260806 15:11:37.611838 16824 leader_election.cc:302] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89c2086a0217450bb734c8567aee92f2, da5e9929e3d647dd96852db0b2127f57; no voters:
I20260806 15:11:37.611987 17095 raft_consensus.cc:2781] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:11:37.612056 17095 raft_consensus.cc:482] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:11:37.612092 17095 raft_consensus.cc:3037] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:37.613041 17095 raft_consensus.cc:504] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.613195 17095 leader_election.cc:288] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [CANDIDATE]: Term 1 election: Requested vote from peers 48a9f7420d8741869ddd288ae0ab6eda (127.29.69.131:38511), da5e9929e3d647dd96852db0b2127f57 (127.29.69.129:44019)
I20260806 15:11:37.613368 16758 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c55f2327d44ea6bd77946f28315ba2" candidate_uuid: "89c2086a0217450bb734c8567aee92f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "da5e9929e3d647dd96852db0b2127f57"
I20260806 15:11:37.613381 17024 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6c55f2327d44ea6bd77946f28315ba2" candidate_uuid: "89c2086a0217450bb734c8567aee92f2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48a9f7420d8741869ddd288ae0ab6eda"
I20260806 15:11:37.613449 17024 raft_consensus.cc:3037] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:37.613451 16758 raft_consensus.cc:3037] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:37.614399 16758 raft_consensus.cc:2454] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c2086a0217450bb734c8567aee92f2 in term 1.
I20260806 15:11:37.614399 17024 raft_consensus.cc:2454] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89c2086a0217450bb734c8567aee92f2 in term 1.
I20260806 15:11:37.614576 16824 leader_election.cc:302] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 89c2086a0217450bb734c8567aee92f2, da5e9929e3d647dd96852db0b2127f57; no voters:
I20260806 15:11:37.614668 17095 raft_consensus.cc:2781] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:37.614846 17095 raft_consensus.cc:686] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 1 LEADER]: Becoming Leader. State: Replica: 89c2086a0217450bb734c8567aee92f2, State: Running, Role: LEADER
I20260806 15:11:37.614959 17095 consensus_queue.cc:237] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } }
I20260806 15:11:37.615869 16615 catalog_manager.cc:5495] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89c2086a0217450bb734c8567aee92f2 (127.29.69.130). New cstate: current_term: 1 leader_uuid: "89c2086a0217450bb734c8567aee92f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89c2086a0217450bb734c8567aee92f2" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 43967 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 } health_report { overall_health: UNKNOWN } } }
I20260806 15:11:37.629957 17086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.627284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44416 (local address 127.29.69.130:43967)
0806 15:11:37.627377 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:37.627379 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:37.627389 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:11:37.627424 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:37.627425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:37.627445 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:37.627512 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:11:37.627689 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.628167 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.629037 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:37.629259 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:37.629325 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:37.629499 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:11:37.629670 (+ 171us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:11:37.629751 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:37.629808 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 15:11:37.629816 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260806 15:11:37.632105 17024 raft_consensus.cc:1261] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 1 FOLLOWER]: Refusing update from remote peer 89c2086a0217450bb734c8567aee92f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:37.632128 16758 raft_consensus.cc:1261] T c6c55f2327d44ea6bd77946f28315ba2 P da5e9929e3d647dd96852db0b2127f57 [term 1 FOLLOWER]: Refusing update from remote peer 89c2086a0217450bb734c8567aee92f2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:37.632481 17098 consensus_queue.cc:1035] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "48a9f7420d8741869ddd288ae0ab6eda" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 38511 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:37.632633 17095 consensus_queue.cc:1035] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "da5e9929e3d647dd96852db0b2127f57" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 44019 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:37.635200 17101 mvcc.cc:205] Tried to move back new op lower bound from 7315575183897681920 to 7315575183831719936. Current Snapshot: MvccSnapshot[applied={T|T < 7315575183897681920}]
I20260806 15:11:37.638455 16614 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:37.638566 16614 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40218:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:37.639394 16614 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 55ce02919bfa40bca64b1e1b5143aba3: Sending DeleteTablet for 3 replicas of tablet c6c55f2327d44ea6bd77946f28315ba2
I20260806 15:11:37.639750 16872 tablet_service.cc:1514] Processing DeleteTablet for tablet c6c55f2327d44ea6bd77946f28315ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:37 UTC) from {username='slave'} at 127.0.0.1:44406
I20260806 15:11:37.639920 16738 tablet_service.cc:1514] Processing DeleteTablet for tablet c6c55f2327d44ea6bd77946f28315ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:37 UTC) from {username='slave'} at 127.0.0.1:33804
I20260806 15:11:37.640044 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16676
I20260806 15:11:37.640007 17004 tablet_service.cc:1514] Processing DeleteTablet for tablet c6c55f2327d44ea6bd77946f28315ba2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:37 UTC) from {username='slave'} at 127.0.0.1:45694
I20260806 15:11:37.642679 17113 tablet_replica.cc:330] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: stopping tablet replica
I20260806 15:11:37.642871 17113 raft_consensus.cc:2229] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:37.643043 17113 raft_consensus.cc:2258] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:37.643776 17113 ts_tablet_manager.cc:1905] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:37.645690 17113 ts_tablet_manager.cc:1918] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:37.645772 17113 log.cc:1196] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/c6c55f2327d44ea6bd77946f28315ba2
I20260806 15:11:37.646029 17113 ts_tablet_manager.cc:1939] T c6c55f2327d44ea6bd77946f28315ba2 P 48a9f7420d8741869ddd288ae0ab6eda: Deleting consensus metadata
I20260806 15:11:37.646490 16601 catalog_manager.cc:4841] TS 48a9f7420d8741869ddd288ae0ab6eda (127.29.69.131:38511): tablet c6c55f2327d44ea6bd77946f28315ba2 (table test-table [id=73a2c54333884da8943e90960d0309cb]) successfully deleted
W20260806 15:11:37.647562 16599 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:44019 (error 108)
I20260806 15:11:37.647791 17111 tablet_replica.cc:330] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: stopping tablet replica
I20260806 15:11:37.647907 17111 raft_consensus.cc:2229] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:11:37.648051 17111 raft_consensus.cc:2258] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:37.648118 17083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.647960 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:44019 (local address 127.0.0.1:33814)
0806 15:11:37.648031 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.648079 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:44019: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
W20260806 15:11:37.648248 16599 catalog_manager.cc:4584] TS da5e9929e3d647dd96852db0b2127f57 (127.29.69.129:44019): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c6c55f2327d44ea6bd77946f28315ba2: Network error: Client connection negotiation failed: client connection to 127.29.69.129:44019: connect: Connection refused (error 111)
I20260806 15:11:37.648422 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16809
I20260806 15:11:37.648553 17111 ts_tablet_manager.cc:1905] T c6c55f2327d44ea6bd77946f28315ba2 P 89c2086a0217450bb734c8567aee92f2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:37.654290 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16942
I20260806 15:11:37.654378 17083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:37.654242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:43967 (local address 127.0.0.1:44418)
0806 15:11:37.654283 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:37.654341 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.130:43967: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260806 15:11:37.659296 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 16584
2026-08-06T15:11:37Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (686 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:37 dist-test-slave-tm1g krb5kdc[17117](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:37 dist-test-slave-tm1g krb5kdc[17117](info): set up 2 sockets
Aug 06 15:11:37 dist-test-slave-tm1g krb5kdc[17117](info): commencing operation
krb5kdc: starting...
W20260806 15:11:38.707005 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:38 dist-test-slave-tm1g krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:11:38.833792 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40207
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:40207
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:38.915126 17130 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:38.915373 17130 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:38.915409 17130 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:38.916566 17130 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:38.916641 17130 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:38.916666 17130 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:38.916688 17130 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:38.916716 17130 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:38.918182 17130 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:40207
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:40207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17130
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:38.918486 17130 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:38.918723 17130 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:38.923594 17136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:38.923588 17138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:38.923588 17135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:38.923779 17130 server_base.cc:1034] running on GCE node
I20260806 15:11:38.924052 17130 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:38.924369 17130 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:38.925544 17130 hybrid_clock.cc:648] HybridClock initialized: now 1786029098925548 us; error 48 us; skew 500 ppm
Aug 06 15:11:38 dist-test-slave-tm1g krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029098, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:38.927999 17130 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:11:38.928445 17130 webserver.cc:460] Webserver started at http://127.29.69.190:32887/ using document root <none> and password file <none>
I20260806 15:11:38.928635 17130 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:38.928675 17130 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:38.928766 17130 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:38.929754 17130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5"
format_stamp: "Formatted at 2026-08-06 15:11:38 on dist-test-slave-tm1g"
server_key: "2a6c931343557dc90db69fd698a275ec"
server_key_iv: "d3a635985c2bd558a7c033c74dd8b934"
server_key_version: "encryptionkey@0"
I20260806 15:11:38.930142 17130 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5"
format_stamp: "Formatted at 2026-08-06 15:11:38 on dist-test-slave-tm1g"
server_key: "2a6c931343557dc90db69fd698a275ec"
server_key_iv: "d3a635985c2bd558a7c033c74dd8b934"
server_key_version: "encryptionkey@0"
I20260806 15:11:38.931502 17130 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:38.932209 17145 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:38.932374 17130 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:38.932464 17130 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5"
format_stamp: "Formatted at 2026-08-06 15:11:38 on dist-test-slave-tm1g"
server_key: "2a6c931343557dc90db69fd698a275ec"
server_key_iv: "d3a635985c2bd558a7c033c74dd8b934"
server_key_version: "encryptionkey@0"
I20260806 15:11:38.932538 17130 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:38.944478 17130 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:38.946759 17130 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:38.946919 17130 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:38.951148 17130 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:40207
I20260806 15:11:38.951179 17198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:40207 every 8 connection(s)
I20260806 15:11:38.951536 17130 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:38.952409 17199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:38.954702 17199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5: Bootstrap starting.
I20260806 15:11:38.955291 17199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:38.955600 17199 log.cc:824] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:38.956272 17199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5: No bootstrap required, opened a new log
I20260806 15:11:38.957844 17199 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40207 } }
I20260806 15:11:38.957998 17199 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:38.958021 17199 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f51e4dc6b8f45a5b8f2139a519e0da5, State: Initialized, Role: FOLLOWER
I20260806 15:11:38.958196 17199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40207 } }
I20260806 15:11:38.958287 17199 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:38.958359 17199 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:38.958415 17199 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:38.958859 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17130
I20260806 15:11:38.958988 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:38.959005 17199 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40207 } }
I20260806 15:11:38.959113 17199 leader_election.cc:302] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f51e4dc6b8f45a5b8f2139a519e0da5; no voters:
I20260806 15:11:38.959213 29974 external_mini_cluster.cc:1428] Setting key 0046b939697f57e3279cb5fcb2885fc6
I20260806 15:11:38.959300 17199 leader_election.cc:288] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:38.959324 17202 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:38.959436 17202 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [term 1 LEADER]: Becoming Leader. State: Replica: 9f51e4dc6b8f45a5b8f2139a519e0da5, State: Running, Role: LEADER
I20260806 15:11:38.959534 17202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40207 } }
I20260806 15:11:38.959568 17199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:38.959896 17202 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40207 } } }
I20260806 15:11:38.959980 17202 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:38.960120 17203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9f51e4dc6b8f45a5b8f2139a519e0da5. Latest consensus state: current_term: 1 leader_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f51e4dc6b8f45a5b8f2139a519e0da5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 40207 } } }
I20260806 15:11:38.960206 17203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:38.960661 17209 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:38.961228 17209 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:38.963097 17209 catalog_manager.cc:1347] Generated new cluster ID: 9d4ac20df30440e2981c065900797459
I20260806 15:11:38.963158 17209 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:11:38 dist-test-slave-tm1g krb5kdc[17117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029098, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:38.971478 17206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:38.959707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34178 (local address 127.29.69.190:40207)
0806 15:11:38.959853 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:38.959863 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:38.960434 (+ 571us) server_negotiation.cc:407] Connection header received
0806 15:11:38.960558 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:38.960566 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:38.960626 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:38.960763 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:38.961771 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:38.963069 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:38.964129 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:38.964761 (+ 632us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:38.964847 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:38.967556 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:38.967560 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:38.967561 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:38.967572 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:38.969578 (+ 2006us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:38.969925 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:38.969928 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:38.969928 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:38.970036 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:38.970209 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:38.970210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:38.970210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:38.970501 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:38.970632 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:38.971116 (+ 484us) server_negotiation.cc:299] Negotiation successful
0806 15:11:38.971246 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":62,"threads_started":1}
I20260806 15:11:38.982507 17209 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:38.983222 17209 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:38.986148 17209 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5: Generated new TSK 0
I20260806 15:11:38.986346 17209 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.29.69.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
Entry for principal kudu/127.29.69.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab.
I20260806 15:11:39.015482 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40207
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:39.101617 17227 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:39.101815 17227 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:39.101840 17227 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:39.103018 17227 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:39.103060 17227 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:39.103085 17227 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:39.104508 17227 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.129.keytab
--principal=kudu/127.29.69.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17227
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:39.104748 17227 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:39.104997 17227 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:39.109920 17232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.109935 17235 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.110143 17227 server_base.cc:1034] running on GCE node
W20260806 15:11:39.109989 17233 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.110481 17227 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:39.110766 17227 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:39.111940 17227 hybrid_clock.cc:648] HybridClock initialized: now 1786029099111931 us; error 40 us; skew 500 ppm
Aug 06 15:11:39 dist-test-slave-tm1g krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029099, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:39.114395 17227 init.cc:377] Logged in from keytab as kudu/127.29.69.129@KRBTEST.COM (short username kudu)
I20260806 15:11:39.114871 17227 webserver.cc:460] Webserver started at http://127.29.69.129:45301/ using document root <none> and password file <none>
I20260806 15:11:39.115098 17227 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:39.115166 17227 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:39.115302 17227 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:39.116336 17227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "70599919c36c44088ca8b90ac99cf311"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "b6140df09f61ab78e6b90c34c6646fd6"
server_key_iv: "360413577758cbb0a2ae7cc42d73f7c2"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.116707 17227 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "70599919c36c44088ca8b90ac99cf311"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "b6140df09f61ab78e6b90c34c6646fd6"
server_key_iv: "360413577758cbb0a2ae7cc42d73f7c2"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.118042 17227 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:39.118896 17242 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.119103 17227 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:11:39.119212 17227 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "70599919c36c44088ca8b90ac99cf311"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "b6140df09f61ab78e6b90c34c6646fd6"
server_key_iv: "360413577758cbb0a2ae7cc42d73f7c2"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.119293 17227 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:39.136034 17227 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:39.138389 17227 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:39.138554 17227 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:39.138792 17227 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:39.139101 17227 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:39.139154 17227 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.139196 17227 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:39.139223 17227 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.145110 17227 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:36863
I20260806 15:11:39.145165 17356 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:36863 every 8 connection(s)
I20260806 15:11:39.145488 17227 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:39.150866 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17227
I20260806 15:11:39.151000 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:11:39.151252 29974 external_mini_cluster.cc:1428] Setting key 9c3e27dab54b8152cc93261eec4e45fc
Aug 06 15:11:39 dist-test-slave-tm1g krb5kdc[17117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029099, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.129@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:39.155085 17359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.146138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40207 (local address 127.29.69.129:40839)
0806 15:11:39.146280 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.146363 (+ 83us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.146880 (+ 517us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.147137 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.147141 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.147701 (+ 560us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:39.147889 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.147894 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.148612 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.148613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.149426 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.149429 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.149860 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.149862 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.149983 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.150535 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:39.150546 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:39.152114 (+ 1568us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:39.153711 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:39.153719 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:39.153722 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:39.153948 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:39.154174 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:39.154174 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:39.154175 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:39.154291 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:39.154597 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:39.154604 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:39.154719 (+ 115us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.154802 (+ 83us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.154920 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260806 15:11:39.155114 17206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.146168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:40839 (local address 127.29.69.190:40207)
0806 15:11:39.146210 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.146213 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.146459 (+ 246us) server_negotiation.cc:407] Connection header received
0806 15:11:39.146998 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.146999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.147017 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.147069 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.147998 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.148511 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.149531 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.149745 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.149835 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.152217 (+ 2382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.152219 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.152220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:39.152227 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.153610 (+ 1383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.154038 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.154040 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.154040 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.154103 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.154384 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.154385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.154386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.154539 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.154607 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.154865 (+ 258us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.154981 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:11:39.155673 17357 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40207
I20260806 15:11:39.155781 17357 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:39.155999 17357 heartbeater.cc:511] Master 127.29.69.190:40207 requested a full tablet report, sending...
I20260806 15:11:39.156598 17163 ts_manager.cc:194] Registered new tserver with Master: 70599919c36c44088ca8b90ac99cf311 (127.29.69.129:36863)
I20260806 15:11:39.157569 17163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.129@KRBTEST.COM'} at 127.29.69.129:40839
WARNING: no policy specified for kudu/127.29.69.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
Entry for principal kudu/127.29.69.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab.
I20260806 15:11:39.176681 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40207
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:39.257282 17363 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:39.257519 17363 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:39.257553 17363 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:39.258713 17363 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:39.258782 17363 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:39.258829 17363 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:39.260409 17363 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.130.keytab
--principal=kudu/127.29.69.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17363
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:39.260671 17363 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:39.260900 17363 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:39.265925 17371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.265939 17368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.265944 17369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.266201 17363 server_base.cc:1034] running on GCE node
I20260806 15:11:39.266435 17363 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:39.266671 17363 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:39.267839 17363 hybrid_clock.cc:648] HybridClock initialized: now 1786029099267816 us; error 36 us; skew 500 ppm
Aug 06 15:11:39 dist-test-slave-tm1g krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029099, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:39.270257 17363 init.cc:377] Logged in from keytab as kudu/127.29.69.130@KRBTEST.COM (short username kudu)
I20260806 15:11:39.270748 17363 webserver.cc:460] Webserver started at http://127.29.69.130:44357/ using document root <none> and password file <none>
I20260806 15:11:39.270998 17363 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:39.271075 17363 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:39.271212 17363 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:39.272228 17363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "55432f3e50314ac888dd7fd3eadf0e43"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "4136989242b20def281723cc7674c0f4"
server_key_iv: "948b8f4a4b880f59e7ed8f6b8cd4e7e1"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.272596 17363 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "55432f3e50314ac888dd7fd3eadf0e43"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "4136989242b20def281723cc7674c0f4"
server_key_iv: "948b8f4a4b880f59e7ed8f6b8cd4e7e1"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.273914 17363 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:39.274688 17378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.274859 17363 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.274959 17363 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "55432f3e50314ac888dd7fd3eadf0e43"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "4136989242b20def281723cc7674c0f4"
server_key_iv: "948b8f4a4b880f59e7ed8f6b8cd4e7e1"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.275043 17363 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:39.287626 17363 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:39.289516 17363 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:39.289680 17363 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:39.289908 17363 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:39.290220 17363 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:39.290277 17363 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.290310 17363 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:39.290380 17363 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.296340 17363 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:33851
I20260806 15:11:39.296396 17492 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:33851 every 8 connection(s)
I20260806 15:11:39.296700 17363 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:39.301416 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17363
I20260806 15:11:39.301570 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:11:39.301779 29974 external_mini_cluster.cc:1428] Setting key 6b1cb2b8689827c5023d09e65c5eeade
Aug 06 15:11:39 dist-test-slave-tm1g krb5kdc[17117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029099, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.130@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:39.306154 17206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.297416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:50263 (local address 127.29.69.190:40207)
0806 15:11:39.297501 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.297503 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.297666 (+ 163us) server_negotiation.cc:407] Connection header received
0806 15:11:39.298133 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.298135 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.298145 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.298193 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.299175 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.299682 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.300640 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.300822 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.300872 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.303269 (+ 2397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.303270 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.303271 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:39.303279 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.304716 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.305141 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.305142 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.305142 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.305206 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.305474 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.305475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.305476 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.305595 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.305670 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.305953 (+ 283us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.306065 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260806 15:11:39.306294 17495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.297361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40207 (local address 127.29.69.130:50263)
0806 15:11:39.297548 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.297584 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.298053 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.298250 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.298253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.298888 (+ 635us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:39.299089 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.299093 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.299766 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.299767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.300562 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.300564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.300894 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.300895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.300998 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.301556 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:39.301566 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:39.303175 (+ 1609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:39.304821 (+ 1646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:39.304829 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:39.304831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:39.305058 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:39.305276 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:39.305277 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:39.305278 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:39.305403 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:39.305672 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:39.305680 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:39.305817 (+ 137us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.305919 (+ 102us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.306077 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":98,"threads_started":1}
I20260806 15:11:39.306764 17493 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40207
I20260806 15:11:39.306869 17493 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:39.307076 17493 heartbeater.cc:511] Master 127.29.69.190:40207 requested a full tablet report, sending...
I20260806 15:11:39.307459 17163 ts_manager.cc:194] Registered new tserver with Master: 55432f3e50314ac888dd7fd3eadf0e43 (127.29.69.130:33851)
I20260806 15:11:39.307850 17163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.130@KRBTEST.COM'} at 127.29.69.130:50263
WARNING: no policy specified for kudu/127.29.69.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
Entry for principal kudu/127.29.69.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab.
I20260806 15:11:39.327163 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40207
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43233
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:39.409554 17498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:39.409744 17498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:39.409766 17498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:39.410847 17498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:39.410880 17498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:39.410907 17498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:39.412315 17498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43233
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.131.keytab
--principal=kudu/127.29.69.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:40207
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:39.412492 17498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:39.412655 17498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:39.417450 17504 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.417482 17503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.417510 17506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.417673 17498 server_base.cc:1034] running on GCE node
I20260806 15:11:39.417917 17498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:39.418175 17498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:39.419335 17498 hybrid_clock.cc:648] HybridClock initialized: now 1786029099419329 us; error 39 us; skew 500 ppm
Aug 06 15:11:39 dist-test-slave-tm1g krb5kdc[17117](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029099, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:39.421802 17498 init.cc:377] Logged in from keytab as kudu/127.29.69.131@KRBTEST.COM (short username kudu)
I20260806 15:11:39.422348 17498 webserver.cc:460] Webserver started at http://127.29.69.131:45995/ using document root <none> and password file <none>
I20260806 15:11:39.422586 17498 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:39.422654 17498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:39.422811 17498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:39.423810 17498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "5af0a80f4b6149c8b171172c1554a365"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "fa3cf6f5358db63dc980d0fb304d6e7e"
server_key_iv: "604b3aa270930d8ab696de45e4469584"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.424176 17498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "5af0a80f4b6149c8b171172c1554a365"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "fa3cf6f5358db63dc980d0fb304d6e7e"
server_key_iv: "604b3aa270930d8ab696de45e4469584"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.425510 17498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:39.426188 17514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.426386 17498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:39.426498 17498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "5af0a80f4b6149c8b171172c1554a365"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "fa3cf6f5358db63dc980d0fb304d6e7e"
server_key_iv: "604b3aa270930d8ab696de45e4469584"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.426584 17498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:39.450599 17498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:39.453416 17498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:39.453619 17498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:39.453915 17498 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:39.454267 17498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:39.454348 17498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.454452 17498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:39.454487 17498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.460805 17498 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:36569
I20260806 15:11:39.460873 17629 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:36569 every 8 connection(s)
I20260806 15:11:39.461193 17498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:11:39.461746 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17498
I20260806 15:11:39.461862 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:11:39.462064 29974 external_mini_cluster.cc:1428] Setting key d016dcdf1fa79c17e3aafad11a674454
Aug 06 15:11:39 dist-test-slave-tm1g krb5kdc[17117](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029099, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.131@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:39.471158 17206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.462636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:60505 (local address 127.29.69.190:40207)
0806 15:11:39.462681 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.462683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.463019 (+ 336us) server_negotiation.cc:407] Connection header received
0806 15:11:39.463563 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.463564 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.463575 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.463623 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.464512 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.465006 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.466012 (+ 1006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.466194 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.466240 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.468414 (+ 2174us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.468415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.468415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:39.468422 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.469817 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.470272 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.470273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.470274 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.470372 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.470583 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.470584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.470584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.470692 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.470746 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.471014 (+ 268us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.471092 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:11:39.471416 17632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.462656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:40207 (local address 127.29.69.131:60505)
0806 15:11:39.462866 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.462923 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.463477 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.463672 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.463676 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.464239 (+ 563us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:39.464438 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.464443 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.465105 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.465106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.465927 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.465929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.466262 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.466263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.466445 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.466982 (+ 537us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:11:39.466991 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:39.468328 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:39.469957 (+ 1629us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:39.469965 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:39.469967 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:39.470202 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:39.470422 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:11:39.470422 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:11:39.470422 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:11:39.470523 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:11:39.470750 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:39.470755 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:39.470867 (+ 112us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.470949 (+ 82us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.471158 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":109,"threads_started":1}
I20260806 15:11:39.471869 17630 heartbeater.cc:347] Connected to a master server at 127.29.69.190:40207
I20260806 15:11:39.471951 17630 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:39.472095 17630 heartbeater.cc:511] Master 127.29.69.190:40207 requested a full tablet report, sending...
I20260806 15:11:39.472407 17163 ts_manager.cc:194] Registered new tserver with Master: 5af0a80f4b6149c8b171172c1554a365 (127.29.69.131:36569)
I20260806 15:11:39.472779 17163 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.29.69.131@KRBTEST.COM'} at 127.29.69.131:60505
I20260806 15:11:39.473809 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:11:39.480695 17206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.475134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34182 (local address 127.29.69.190:40207)
0806 15:11:39.475197 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.475199 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.475308 (+ 109us) server_negotiation.cc:407] Connection header received
0806 15:11:39.475346 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.475347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.475357 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.475406 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.475898 (+ 492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.476347 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.477017 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.477195 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.477248 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.478446 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.478448 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.478448 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:39.478454 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.479752 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.480084 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.480085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.480085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.480134 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:39.480288 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:39.480288 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:39.480288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:39.480408 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.480481 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.480581 (+ 100us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.480637 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:11:39.482391 17163 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34182:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:11:39.483946 17163 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:11:39.490598 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.486433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:36863 (local address 127.0.0.1:56060)
0806 15:11:39.486848 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.486858 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.486904 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.487152 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.487153 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.487156 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:39.487210 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.487212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.488091 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.488092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.489272 (+ 1180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.489275 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.490235 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.490236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.490360 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.490379 (+ 19us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.490445 (+ 66us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.490507 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":401,"mutex_wait_us":2,"thread_start_us":37,"threads_started":1}
I20260806 15:11:39.490674 17642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.486539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54700 (local address 127.29.69.130:33851)
0806 15:11:39.486722 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.486727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.486738 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:11:39.486780 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.486781 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.486796 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.487222 (+ 426us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:39.487301 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.488371 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.489562 (+ 1191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.490270 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.490412 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.490476 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.490545 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.490590 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260806 15:11:39.491073 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.486650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56060 (local address 127.29.69.129:36863)
0806 15:11:39.486892 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.486896 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.486906 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:11:39.486973 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.486975 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.486991 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.487076 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:39.487294 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.487979 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.489384 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.490136 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.490223 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.490282 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.490940 (+ 658us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.490981 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":104,"threads_started":1}
I20260806 15:11:39.490665 17639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.486200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:33851 (local address 127.0.0.1:54700)
0806 15:11:39.486361 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.486400 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.486461 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.487071 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.487074 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.487076 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:39.487146 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.487148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.488499 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.488500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.489479 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.489481 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.490413 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.490413 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.490472 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.490474 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.490530 (+ 56us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.490568 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":57,"threads_started":1}
I20260806 15:11:39.491400 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.486326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40194 (local address 127.29.69.131:36569)
0806 15:11:39.486486 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.486491 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.486793 (+ 302us) server_negotiation.cc:407] Connection header received
0806 15:11:39.486903 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.486905 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.486922 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.486977 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:39.487246 (+ 269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.488382 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.490344 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.490994 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.491054 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.491087 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.491252 (+ 165us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.491300 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":75,"threads_started":1}
I20260806 15:11:39.491356 17638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.486207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36569 (local address 127.0.0.1:40194)
0806 15:11:39.486707 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.486716 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.486801 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.487086 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.487087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.487090 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:39.487175 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.487177 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.489550 (+ 2373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.489551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.490222 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.490224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.491083 (+ 859us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.491084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.491158 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.491163 (+ 5us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.491226 (+ 63us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.491268 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":488,"mutex_wait_us":5,"thread_start_us":77,"threads_started":1}
I20260806 15:11:39.492271 17426 tablet_service.cc:1467] Processing CreateTablet for tablet 7ce67953b8704e679914ea1414bb142e (DEFAULT_TABLE table=test-table [id=cb005603a7224443b57b24cf2d8e56f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:39.492451 17290 tablet_service.cc:1467] Processing CreateTablet for tablet 7ce67953b8704e679914ea1414bb142e (DEFAULT_TABLE table=test-table [id=cb005603a7224443b57b24cf2d8e56f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:39.492681 17426 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ce67953b8704e679914ea1414bb142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:39.492748 17290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ce67953b8704e679914ea1414bb142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:39.494675 17563 tablet_service.cc:1467] Processing CreateTablet for tablet 7ce67953b8704e679914ea1414bb142e (DEFAULT_TABLE table=test-table [id=cb005603a7224443b57b24cf2d8e56f5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:39.494995 17563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7ce67953b8704e679914ea1414bb142e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:39.496423 17645 tablet_bootstrap.cc:492] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311: Bootstrap starting.
I20260806 15:11:39.497151 17645 tablet_bootstrap.cc:654] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:39.497778 17645 log.cc:824] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:39.498138 17646 tablet_bootstrap.cc:492] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Bootstrap starting.
I20260806 15:11:39.498096 17644 tablet_bootstrap.cc:492] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: Bootstrap starting.
I20260806 15:11:39.498741 17644 tablet_bootstrap.cc:654] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:39.498761 17646 tablet_bootstrap.cc:654] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:39.499259 17646 log.cc:824] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:39.499294 17645 tablet_bootstrap.cc:492] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311: No bootstrap required, opened a new log
I20260806 15:11:39.499318 17644 log.cc:824] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:39.499356 17645 ts_tablet_manager.cc:1397] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:11:39.500069 17644 tablet_bootstrap.cc:492] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: No bootstrap required, opened a new log
I20260806 15:11:39.500075 17646 tablet_bootstrap.cc:492] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: No bootstrap required, opened a new log
I20260806 15:11:39.500152 17646 ts_tablet_manager.cc:1397] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:39.500155 17644 ts_tablet_manager.cc:1397] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:39.501389 17645 raft_consensus.cc:348] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.501579 17645 raft_consensus.cc:374] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:39.501616 17645 raft_consensus.cc:729] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 70599919c36c44088ca8b90ac99cf311, State: Initialized, Role: FOLLOWER
I20260806 15:11:39.501484 17644 raft_consensus.cc:348] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.501683 17644 raft_consensus.cc:374] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:39.501739 17644 raft_consensus.cc:729] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55432f3e50314ac888dd7fd3eadf0e43, State: Initialized, Role: FOLLOWER
I20260806 15:11:39.501749 17645 consensus_queue.cc:260] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.501852 17644 consensus_queue.cc:260] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.502036 17645 ts_tablet_manager.cc:1428] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:39.502094 17357 heartbeater.cc:503] Master 127.29.69.190:40207 was elected leader, sending a full tablet report...
I20260806 15:11:39.502132 17644 ts_tablet_manager.cc:1428] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260806 15:11:39.502081 17646 raft_consensus.cc:348] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.502229 17493 heartbeater.cc:503] Master 127.29.69.190:40207 was elected leader, sending a full tablet report...
I20260806 15:11:39.502250 17646 raft_consensus.cc:374] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:39.502283 17646 raft_consensus.cc:729] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af0a80f4b6149c8b171172c1554a365, State: Initialized, Role: FOLLOWER
I20260806 15:11:39.502447 17646 consensus_queue.cc:260] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.502707 17646 ts_tablet_manager.cc:1428] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260806 15:11:39.502823 17630 heartbeater.cc:503] Master 127.29.69.190:40207 was elected leader, sending a full tablet report...
I20260806 15:11:39.514030 17650 raft_consensus.cc:482] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:39.514124 17650 raft_consensus.cc:504] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.514611 17650 leader_election.cc:288] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 55432f3e50314ac888dd7fd3eadf0e43 (127.29.69.130:33851), 5af0a80f4b6149c8b171172c1554a365 (127.29.69.131:36569)
I20260806 15:11:39.517681 17642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.514868 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:38639 (local address 127.29.69.130:33851)
0806 15:11:39.514916 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.514918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.514927 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:39.514953 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.514954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.514962 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.515022 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:39.515171 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.515709 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.516811 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.517367 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.517422 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.517430 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.517602 (+ 172us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.517634 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:11:39.517700 17359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.514744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:33851 (local address 127.29.69.129:38639)
0806 15:11:39.514797 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.514810 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.514865 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.515030 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.515031 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.515033 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:39.515110 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.515111 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.515791 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.515792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.516712 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.516715 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.517444 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.517446 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.517529 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.517532 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.517590 (+ 58us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.517629 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 15:11:39.518030 17446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce67953b8704e679914ea1414bb142e" candidate_uuid: "70599919c36c44088ca8b90ac99cf311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55432f3e50314ac888dd7fd3eadf0e43" is_pre_election: true
I20260806 15:11:39.518136 17654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.514809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:36569 (local address 127.29.69.129:58455)
0806 15:11:39.514963 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.514971 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.515014 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.515265 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.515266 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.515268 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:39.515327 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.515328 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.516267 (+ 939us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.516267 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.517171 (+ 904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.517174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.517907 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.517909 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.517989 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.517995 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.518052 (+ 57us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.518084 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":93,"threads_started":1}
I20260806 15:11:39.518183 17640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.514882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:58455 (local address 127.29.69.131:36569)
0806 15:11:39.514927 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.514930 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.515167 (+ 237us) server_negotiation.cc:407] Connection header received
0806 15:11:39.515187 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.515188 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.515196 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.515261 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:39.515531 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.516171 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.517261 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.517798 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.517860 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.517868 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.518085 (+ 217us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.518125 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:11:39.518200 17446 raft_consensus.cc:2454] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70599919c36c44088ca8b90ac99cf311 in term 0.
I20260806 15:11:39.518438 17243 leader_election.cc:302] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 55432f3e50314ac888dd7fd3eadf0e43, 70599919c36c44088ca8b90ac99cf311; no voters:
I20260806 15:11:39.518486 17583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce67953b8704e679914ea1414bb142e" candidate_uuid: "70599919c36c44088ca8b90ac99cf311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af0a80f4b6149c8b171172c1554a365" is_pre_election: true
I20260806 15:11:39.518570 17650 raft_consensus.cc:2781] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:11:39.518628 17650 raft_consensus.cc:482] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:11:39.518640 17583 raft_consensus.cc:2454] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 70599919c36c44088ca8b90ac99cf311 in term 0.
I20260806 15:11:39.518662 17650 raft_consensus.cc:3037] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:39.519402 17650 raft_consensus.cc:504] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.519547 17650 leader_election.cc:288] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [CANDIDATE]: Term 1 election: Requested vote from peers 55432f3e50314ac888dd7fd3eadf0e43 (127.29.69.130:33851), 5af0a80f4b6149c8b171172c1554a365 (127.29.69.131:36569)
I20260806 15:11:39.519685 17446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce67953b8704e679914ea1414bb142e" candidate_uuid: "70599919c36c44088ca8b90ac99cf311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "55432f3e50314ac888dd7fd3eadf0e43"
I20260806 15:11:39.519713 17583 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ce67953b8704e679914ea1414bb142e" candidate_uuid: "70599919c36c44088ca8b90ac99cf311" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5af0a80f4b6149c8b171172c1554a365"
I20260806 15:11:39.519758 17446 raft_consensus.cc:3037] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:39.519781 17583 raft_consensus.cc:3037] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:39.520501 17583 raft_consensus.cc:2454] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70599919c36c44088ca8b90ac99cf311 in term 1.
I20260806 15:11:39.520529 17446 raft_consensus.cc:2454] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 70599919c36c44088ca8b90ac99cf311 in term 1.
I20260806 15:11:39.520716 17244 leader_election.cc:302] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5af0a80f4b6149c8b171172c1554a365, 70599919c36c44088ca8b90ac99cf311; no voters:
I20260806 15:11:39.520838 17650 raft_consensus.cc:2781] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:39.520996 17650 raft_consensus.cc:686] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [term 1 LEADER]: Becoming Leader. State: Replica: 70599919c36c44088ca8b90ac99cf311, State: Running, Role: LEADER
I20260806 15:11:39.521102 17650 consensus_queue.cc:237] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } }
I20260806 15:11:39.521869 17161 catalog_manager.cc:5495] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 reported cstate change: term changed from 0 to 1, leader changed from <none> to 70599919c36c44088ca8b90ac99cf311 (127.29.69.129). New cstate: current_term: 1 leader_uuid: "70599919c36c44088ca8b90ac99cf311" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "70599919c36c44088ca8b90ac99cf311" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 36863 } health_report { overall_health: HEALTHY } } }
I20260806 15:11:39.535553 17643 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.533086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56072 (local address 127.29.69.129:36863)
0806 15:11:39.533153 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.533155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.533164 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:11:39.533243 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.533244 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.533259 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.533335 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:11:39.533484 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.533930 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.534770 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.535008 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.535091 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.535249 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:11:39.535348 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:11:39.535439 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.535458 (+ 19us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.535478 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 15:11:39.537252 17583 raft_consensus.cc:1261] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 1 FOLLOWER]: Refusing update from remote peer 70599919c36c44088ca8b90ac99cf311: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:39.537253 17446 raft_consensus.cc:1261] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 1 FOLLOWER]: Refusing update from remote peer 70599919c36c44088ca8b90ac99cf311: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:39.537591 17655 consensus_queue.cc:1035] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5af0a80f4b6149c8b171172c1554a365" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 36569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:39.537745 17650 consensus_queue.cc:1035] T 7ce67953b8704e679914ea1414bb142e P 70599919c36c44088ca8b90ac99cf311 [LEADER]: Connected to new peer: Peer: permanent_uuid: "55432f3e50314ac888dd7fd3eadf0e43" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:39.540053 17658 mvcc.cc:205] Tried to move back new op lower bound from 7315575191702077440 to 7315575191638990848. Current Snapshot: MvccSnapshot[applied={T|T < 7315575191702077440}]
I20260806 15:11:39.540306 17659 mvcc.cc:205] Tried to move back new op lower bound from 7315575191702077440 to 7315575191638990848. Current Snapshot: MvccSnapshot[applied={T|T < 7315575191702077440}]
I20260806 15:11:39.541217 17660 mvcc.cc:205] Tried to move back new op lower bound from 7315575191702077440 to 7315575191638990848. Current Snapshot: MvccSnapshot[applied={T|T < 7315575191702077440}]
I20260806 15:11:39.542484 17162 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:39.542583 17162 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34182:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:39.543325 17162 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9f51e4dc6b8f45a5b8f2139a519e0da5: Sending DeleteTablet for 3 replicas of tablet 7ce67953b8704e679914ea1414bb142e
I20260806 15:11:39.543645 17563 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ce67953b8704e679914ea1414bb142e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:39 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:40194
I20260806 15:11:39.543643 17426 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ce67953b8704e679914ea1414bb142e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:39 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:54700
I20260806 15:11:39.543660 17290 tablet_service.cc:1514] Processing DeleteTablet for tablet 7ce67953b8704e679914ea1414bb142e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:39 UTC) from {username='kudu', principal='kudu/127.29.69.190@KRBTEST.COM'} at 127.0.0.1:56060
I20260806 15:11:39.543932 17669 tablet_replica.cc:330] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: stopping tablet replica
I20260806 15:11:39.544032 17669 raft_consensus.cc:2229] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:39.544015 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17227
I20260806 15:11:39.545008 17668 tablet_replica.cc:330] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: stopping tablet replica
I20260806 15:11:39.545096 17668 raft_consensus.cc:2229] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:39.545181 17668 raft_consensus.cc:2258] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:39.545212 17669 raft_consensus.cc:2258] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:39.545629 17668 ts_tablet_manager.cc:1905] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:39.547071 17668 ts_tablet_manager.cc:1918] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:39.547158 17668 log.cc:1196] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/7ce67953b8704e679914ea1414bb142e
I20260806 15:11:39.547412 17668 ts_tablet_manager.cc:1939] T 7ce67953b8704e679914ea1414bb142e P 5af0a80f4b6149c8b171172c1554a365: Deleting consensus metadata
I20260806 15:11:39.547787 17147 catalog_manager.cc:4841] TS 5af0a80f4b6149c8b171172c1554a365 (127.29.69.131:36569): tablet 7ce67953b8704e679914ea1414bb142e (table test-table [id=cb005603a7224443b57b24cf2d8e56f5]) successfully deleted
I20260806 15:11:39.550648 17669 ts_tablet_manager.cc:1905] T 7ce67953b8704e679914ea1414bb142e P 55432f3e50314ac888dd7fd3eadf0e43: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260806 15:11:39.550774 17146 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:36863 (error 108)
I20260806 15:11:39.551045 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17363
I20260806 15:11:39.551221 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.551102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:36863 (local address 127.0.0.1:56086)
0806 15:11:39.551150 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.551185 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:36863: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260806 15:11:39.555034 17146 catalog_manager.cc:4584] TS 70599919c36c44088ca8b90ac99cf311 (127.29.69.129:36863): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7ce67953b8704e679914ea1414bb142e: Network error: Client connection negotiation failed: client connection to 127.29.69.129:36863: connect: Connection refused (error 111)
I20260806 15:11:39.557977 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17498
I20260806 15:11:39.558128 17641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.557974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:33851 (local address 127.0.0.1:54712)
0806 15:11:39.558044 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.558093 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.130:33851: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260806 15:11:39.563427 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17130
2026-08-06T15:11:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (1904 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-06T15:11:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:39Z Disabled control of system clock
I20260806 15:11:39.591735 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46219
--webserver_interface=127.29.69.190
--webserver_port=0
--builtin_ntp_servers=127.29.69.148:44139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46219
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:39.671561 17675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:39.671770 17675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:39.671792 17675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:39.672857 17675 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:39.672894 17675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:39.672907 17675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:39.672919 17675 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:39.672931 17675 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:39.674196 17675 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46219
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46219
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:39.674448 17675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:39.674681 17675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:39.679466 17683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.679462 17681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.679458 17680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.679672 17675 server_base.cc:1034] running on GCE node
I20260806 15:11:39.679929 17675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:39.680254 17675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:39.681420 17675 hybrid_clock.cc:648] HybridClock initialized: now 1786029099681408 us; error 42 us; skew 500 ppm
I20260806 15:11:39.682639 17675 webserver.cc:460] Webserver started at http://127.29.69.190:46753/ using document root <none> and password file <none>
I20260806 15:11:39.682885 17675 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:39.682953 17675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:39.683109 17675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:39.684134 17675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "adac5c5c2a6948dabe68de2df094568f"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "22638f698674aba296aeb0e70669fc31"
server_key_iv: "64d846c059788315a7ec049f12cd038f"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.684501 17675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "adac5c5c2a6948dabe68de2df094568f"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "22638f698674aba296aeb0e70669fc31"
server_key_iv: "64d846c059788315a7ec049f12cd038f"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.685911 17675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:39.686700 17689 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.686897 17675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.687000 17675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "adac5c5c2a6948dabe68de2df094568f"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "22638f698674aba296aeb0e70669fc31"
server_key_iv: "64d846c059788315a7ec049f12cd038f"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.687088 17675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:39.707043 17675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:39.707365 17675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:39.707521 17675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:39.711508 17675 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:46219
I20260806 15:11:39.711548 17741 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:46219 every 8 connection(s)
I20260806 15:11:39.711915 17675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:39.712899 17742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:39.715168 17742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f: Bootstrap starting.
I20260806 15:11:39.715711 17742 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:39.716058 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17675
I20260806 15:11:39.716058 17742 log.cc:824] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:39.716162 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:39.716374 29974 external_mini_cluster.cc:1428] Setting key 0849a543ac5e8188bc849acd2c43d61b
I20260806 15:11:39.716849 17742 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f: No bootstrap required, opened a new log
I20260806 15:11:39.718658 17742 raft_consensus.cc:348] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adac5c5c2a6948dabe68de2df094568f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46219 } }
I20260806 15:11:39.718816 17742 raft_consensus.cc:374] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:39.718894 17742 raft_consensus.cc:729] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adac5c5c2a6948dabe68de2df094568f, State: Initialized, Role: FOLLOWER
I20260806 15:11:39.719043 17742 consensus_queue.cc:260] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adac5c5c2a6948dabe68de2df094568f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46219 } }
I20260806 15:11:39.719143 17742 raft_consensus.cc:388] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:39.719208 17742 raft_consensus.cc:482] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:39.719255 17742 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:39.719785 17742 raft_consensus.cc:504] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adac5c5c2a6948dabe68de2df094568f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46219 } }
I20260806 15:11:39.719879 17742 leader_election.cc:302] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: adac5c5c2a6948dabe68de2df094568f; no voters:
I20260806 15:11:39.720091 17742 leader_election.cc:288] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:39.720140 17747 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:39.720309 17747 raft_consensus.cc:686] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [term 1 LEADER]: Becoming Leader. State: Replica: adac5c5c2a6948dabe68de2df094568f, State: Running, Role: LEADER
I20260806 15:11:39.720347 17742 sys_catalog.cc:564] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:39.720440 17747 consensus_queue.cc:237] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adac5c5c2a6948dabe68de2df094568f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46219 } }
I20260806 15:11:39.720769 17747 sys_catalog.cc:455] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [sys.catalog]: SysCatalogTable state changed. Reason: New leader adac5c5c2a6948dabe68de2df094568f. Latest consensus state: current_term: 1 leader_uuid: "adac5c5c2a6948dabe68de2df094568f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adac5c5c2a6948dabe68de2df094568f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46219 } } }
I20260806 15:11:39.720835 17747 sys_catalog.cc:458] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:39.720785 17748 sys_catalog.cc:455] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adac5c5c2a6948dabe68de2df094568f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adac5c5c2a6948dabe68de2df094568f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46219 } } }
I20260806 15:11:39.720988 17748 sys_catalog.cc:458] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:39.721935 17753 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:39.722550 17753 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:39.724169 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.716901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53492 (local address 127.29.69.190:46219)
0806 15:11:39.717109 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.717116 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.717140 (+ 24us) server_negotiation.cc:407] Connection header received
0806 15:11:39.718643 (+ 1503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.718650 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.718708 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.718849 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.719112 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.721010 (+ 1898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.722161 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.722647 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.722767 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.723484 (+ 717us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.723487 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.723487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:39.723682 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.723718 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:39.723729 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.723813 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.723881 (+ 68us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.723961 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":96,"threads_started":1}
I20260806 15:11:39.724176 17753 catalog_manager.cc:1347] Generated new cluster ID: 8f92505b579f4c98917c4e58629055c2
I20260806 15:11:39.724260 17753 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:39.740161 17753 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:39.740923 17753 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:39.748720 17753 catalog_manager.cc:5868] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f: Generated new TSK 0
I20260806 15:11:39.748960 17753 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:39.756297 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.129:0
--local_ip_for_outbound_sockets=127.29.69.129
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46219
--builtin_ntp_servers=127.29.69.148:44139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:39.837963 17766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:39.838156 17766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:39.838178 17766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:39.839354 17766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:39.839394 17766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:39.839419 17766 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.129
I20260806 15:11:39.840845 17766 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.29.69.129
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.129
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:39.841089 17766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:39.841383 17766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:39.847461 17772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.847422 17771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.847461 17774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.847661 17766 server_base.cc:1034] running on GCE node
I20260806 15:11:39.847997 17766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:39.848233 17766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:39.849404 17766 hybrid_clock.cc:648] HybridClock initialized: now 1786029099849384 us; error 31 us; skew 500 ppm
I20260806 15:11:39.850724 17766 webserver.cc:460] Webserver started at http://127.29.69.129:41933/ using document root <none> and password file <none>
I20260806 15:11:39.850965 17766 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:39.851037 17766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:39.851193 17766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:39.852253 17766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data/instance:
uuid: "d8499526f4b14ec48ed1b1143a1e6601"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "524a20b8a59b6a45d3c9a6d3c576bcc4"
server_key_iv: "0264459acfc2e39708b04ddf0a57aa52"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.852768 17766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance:
uuid: "d8499526f4b14ec48ed1b1143a1e6601"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "524a20b8a59b6a45d3c9a6d3c576bcc4"
server_key_iv: "0264459acfc2e39708b04ddf0a57aa52"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.854154 17766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:39.855041 17780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.855216 17766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:39.855319 17766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal
uuid: "d8499526f4b14ec48ed1b1143a1e6601"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "524a20b8a59b6a45d3c9a6d3c576bcc4"
server_key_iv: "0264459acfc2e39708b04ddf0a57aa52"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.855409 17766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:39.862600 17766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:39.862877 17766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:39.863022 17766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:39.863257 17766 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:39.863571 17766 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:39.863626 17766 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.863667 17766 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:39.863694 17766 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.869637 17766 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.129:40709
I20260806 15:11:39.869686 17894 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.129:40709 every 8 connection(s)
I20260806 15:11:39.869990 17766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/data/info.pb
I20260806 15:11:39.871143 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17766
I20260806 15:11:39.871251 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-0/wal/instance
I20260806 15:11:39.871447 29974 external_mini_cluster.cc:1428] Setting key 78600a928fb1406ff9e38cf9ef5c96ee
I20260806 15:11:39.872555 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.130:0
--local_ip_for_outbound_sockets=127.29.69.130
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46219
--builtin_ntp_servers=127.29.69.148:44139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260806 15:11:39.876139 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.870743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.129:39367 (local address 127.29.69.190:46219)
0806 15:11:39.870819 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.870822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.871143 (+ 321us) server_negotiation.cc:407] Connection header received
0806 15:11:39.871856 (+ 713us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.871857 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.871870 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.871938 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.872803 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.873299 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.874638 (+ 1339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.874867 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.874956 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.875811 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.875812 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.875813 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:39.875817 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.875859 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:39.875864 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.875918 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.876050 (+ 132us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.876083 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:11:39.876431 17897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.870756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46219 (local address 127.29.69.129:39367)
0806 15:11:39.870978 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.871027 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.871749 (+ 722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.871987 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.871990 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.871998 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:39.872722 (+ 724us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.872729 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.873401 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.873402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.874543 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.874546 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.874969 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.874970 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.875106 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.875653 (+ 547us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:39.875653 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:39.875680 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:39.875702 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:39.875941 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:39.875950 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:39.875953 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.876044 (+ 91us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.876166 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260806 15:11:39.876955 17895 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46219
I20260806 15:11:39.877060 17895 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:39.877240 17895 heartbeater.cc:511] Master 127.29.69.190:46219 requested a full tablet report, sending...
I20260806 15:11:39.877861 17706 ts_manager.cc:194] Registered new tserver with Master: d8499526f4b14ec48ed1b1143a1e6601 (127.29.69.129:40709)
I20260806 15:11:39.878574 17706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.129:39367
W20260806 15:11:39.954070 17898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:39.954262 17898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:39.954282 17898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:39.955438 17898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:39.955488 17898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:39.955513 17898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.130
I20260806 15:11:39.956832 17898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.29.69.130
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.130
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:39.957064 17898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:39.957358 17898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:39.962440 17904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.962448 17903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:39.962448 17906 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:39.962625 17898 server_base.cc:1034] running on GCE node
I20260806 15:11:39.962831 17898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:39.963017 17898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:39.964193 17898 hybrid_clock.cc:648] HybridClock initialized: now 1786029099964176 us; error 30 us; skew 500 ppm
I20260806 15:11:39.965363 17898 webserver.cc:460] Webserver started at http://127.29.69.130:43371/ using document root <none> and password file <none>
I20260806 15:11:39.965612 17898 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:39.965682 17898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:39.965843 17898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:39.966930 17898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data/instance:
uuid: "ac593f9d5e88428e90e642ff0734ed3a"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "1182863a43468848dab54da2c954cda6"
server_key_iv: "25ebdcef2e59708a3a2673b0082d06e7"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.967304 17898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance:
uuid: "ac593f9d5e88428e90e642ff0734ed3a"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "1182863a43468848dab54da2c954cda6"
server_key_iv: "25ebdcef2e59708a3a2673b0082d06e7"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.968588 17898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:11:39.969285 17912 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.969458 17898 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:39.969573 17898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal
uuid: "ac593f9d5e88428e90e642ff0734ed3a"
format_stamp: "Formatted at 2026-08-06 15:11:39 on dist-test-slave-tm1g"
server_key: "1182863a43468848dab54da2c954cda6"
server_key_iv: "25ebdcef2e59708a3a2673b0082d06e7"
server_key_version: "encryptionkey@0"
I20260806 15:11:39.969650 17898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:39.983911 17898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:39.984200 17898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:39.984357 17898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:39.984591 17898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:39.984910 17898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:39.984964 17898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.984997 17898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:39.985023 17898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:39.991204 17898 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.130:33861
I20260806 15:11:39.991255 18027 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.130:33861 every 8 connection(s)
I20260806 15:11:39.991564 17898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/data/info.pb
I20260806 15:11:39.996363 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.992255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:51495 (local address 127.29.69.190:46219)
0806 15:11:39.992338 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:39.992340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:39.992573 (+ 233us) server_negotiation.cc:407] Connection header received
0806 15:11:39.993026 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:39.993027 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:39.993036 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:39.993097 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:39.993720 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.994228 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.995197 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.995378 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.995429 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.996151 (+ 722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:39.996152 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:39.996152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:39.996156 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:39.996170 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:39.996174 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:39.996221 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:39.996284 (+ 63us) server_negotiation.cc:299] Negotiation successful
0806 15:11:39.996307 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260806 15:11:39.996563 18030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:39.992248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46219 (local address 127.29.69.130:51495)
0806 15:11:39.992433 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:39.992479 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:39.992940 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:39.993148 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:39.993151 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:39.993159 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:39.993645 (+ 486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.993648 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.994351 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.994352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.995116 (+ 764us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:39.995118 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:39.995452 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:39.995453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:39.995568 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:39.996023 (+ 455us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:39.996024 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:39.996051 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:39.996073 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:39.996223 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:39.996225 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:39.996227 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:11:39.996273 (+ 46us) client_negotiation.cc:240] Negotiation successful
0806 15:11:39.996348 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":93,"threads_started":1}
I20260806 15:11:39.997105 18028 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46219
I20260806 15:11:39.997192 18028 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:39.997327 18028 heartbeater.cc:511] Master 127.29.69.190:46219 requested a full tablet report, sending...
I20260806 15:11:39.997635 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 17898
I20260806 15:11:39.997753 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal/instance
I20260806 15:11:39.997740 17706 ts_manager.cc:194] Registered new tserver with Master: ac593f9d5e88428e90e642ff0734ed3a (127.29.69.130:33861)
I20260806 15:11:39.997962 29974 external_mini_cluster.cc:1428] Setting key 3ba8ac10696ca262f09f6788e37ee78c
I20260806 15:11:39.998207 17706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.130:51495
I20260806 15:11:39.999094 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.29.69.131:0
--local_ip_for_outbound_sockets=127.29.69.131
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46219
--builtin_ntp_servers=127.29.69.148:44139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260806 15:11:40.080003 18031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:40.080196 18031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:40.080217 18031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:40.081329 18031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:40.081370 18031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:40.081395 18031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.29.69.131
I20260806 15:11:40.082804 18031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:44139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.29.69.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.29.69.131
--webserver_port=0
--tserver_master_addrs=127.29.69.190:46219
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.29.69.131
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:40.083051 18031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:40.083348 18031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:40.088573 18037 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:40.088583 18036 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:40.088794 18031 server_base.cc:1034] running on GCE node
W20260806 15:11:40.088583 18039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:40.089035 18031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:40.089303 18031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:40.090480 18031 hybrid_clock.cc:648] HybridClock initialized: now 1786029100090462 us; error 52 us; skew 500 ppm
I20260806 15:11:40.091787 18031 webserver.cc:460] Webserver started at http://127.29.69.131:41355/ using document root <none> and password file <none>
I20260806 15:11:40.092051 18031 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:40.092123 18031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:40.092281 18031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:40.093396 18031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data/instance:
uuid: "f26713b85c0f4d54bacf66ea84bdaf4a"
format_stamp: "Formatted at 2026-08-06 15:11:40 on dist-test-slave-tm1g"
server_key: "73b9022ff689bab991a559ef4a4e4aa5"
server_key_iv: "6ba8bed57dfddf87d884b641430191f5"
server_key_version: "encryptionkey@0"
I20260806 15:11:40.093791 18031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance:
uuid: "f26713b85c0f4d54bacf66ea84bdaf4a"
format_stamp: "Formatted at 2026-08-06 15:11:40 on dist-test-slave-tm1g"
server_key: "73b9022ff689bab991a559ef4a4e4aa5"
server_key_iv: "6ba8bed57dfddf87d884b641430191f5"
server_key_version: "encryptionkey@0"
I20260806 15:11:40.095203 18031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:40.095980 18045 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:40.096165 18031 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:40.096274 18031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal
uuid: "f26713b85c0f4d54bacf66ea84bdaf4a"
format_stamp: "Formatted at 2026-08-06 15:11:40 on dist-test-slave-tm1g"
server_key: "73b9022ff689bab991a559ef4a4e4aa5"
server_key_iv: "6ba8bed57dfddf87d884b641430191f5"
server_key_version: "encryptionkey@0"
I20260806 15:11:40.096350 18031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:40.110415 18031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:40.110721 18031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:40.110870 18031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:40.111100 18031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260806 15:11:40.111426 18031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260806 15:11:40.111481 18031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:40.111528 18031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260806 15:11:40.111574 18031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:40.117369 18031 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.131:42941
I20260806 15:11:40.117450 18160 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.131:42941 every 8 connection(s)
I20260806 15:11:40.117789 18031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/data/info.pb
I20260806 15:11:40.123646 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.118615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.131:42777 (local address 127.29.69.190:46219)
0806 15:11:40.118682 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.118684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.118925 (+ 241us) server_negotiation.cc:407] Connection header received
0806 15:11:40.119520 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.119522 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.119535 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.119606 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:40.120551 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.121168 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.122251 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.122497 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.122557 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.123441 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:40.123442 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:40.123442 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:40.123446 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:40.123457 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:40.123461 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:40.123498 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.123564 (+ 66us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.123588 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 15:11:40.123910 18163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.118601 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46219 (local address 127.29.69.131:42777)
0806 15:11:40.118801 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.118837 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:40.119388 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:40.119677 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:40.119682 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:40.119700 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:11:40.120398 (+ 698us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.120404 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.121249 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.121250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.122170 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.122173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.122575 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.122576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.122693 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.123311 (+ 618us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0806 15:11:40.123311 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:11:40.123340 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0806 15:11:40.123364 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:11:40.123500 (+ 136us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:11:40.123503 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:11:40.123505 (+ 2us) client_negotiation.cc:769] Sending connection context
0806 15:11:40.123556 (+ 51us) client_negotiation.cc:240] Negotiation successful
0806 15:11:40.123636 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260806 15:11:40.123927 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18031
I20260806 15:11:40.124068 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal/instance
I20260806 15:11:40.124261 29974 external_mini_cluster.cc:1428] Setting key 59932805dca39093bb8f73c56064608f
I20260806 15:11:40.124815 18161 heartbeater.cc:347] Connected to a master server at 127.29.69.190:46219
I20260806 15:11:40.124940 18161 heartbeater.cc:464] Registering TS with master...
I20260806 15:11:40.125156 18161 heartbeater.cc:511] Master 127.29.69.190:46219 requested a full tablet report, sending...
I20260806 15:11:40.125583 17706 ts_manager.cc:194] Registered new tserver with Master: f26713b85c0f4d54bacf66ea84bdaf4a (127.29.69.131:42941)
I20260806 15:11:40.125934 17706 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.29.69.131:42777
I20260806 15:11:40.136124 29974 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260806 15:11:40.140573 17746 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.137511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53500 (local address 127.29.69.190:46219)
0806 15:11:40.137578 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.137580 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.137701 (+ 121us) server_negotiation.cc:407] Connection header received
0806 15:11:40.137775 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.137776 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.137788 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.137857 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:40.138029 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.138600 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.139347 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.139539 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.139616 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.140310 (+ 694us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:40.140312 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:40.140312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:40.140317 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:40.140333 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:40.140337 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:40.140404 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.140458 (+ 54us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.140486 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260806 15:11:40.142225 17706 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53500:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260806 15:11:40.143761 17706 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260806 15:11:40.149932 18170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.145873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.130:33861 (local address 127.0.0.1:51290)
0806 15:11:40.146063 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.146102 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:40.146165 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:40.146428 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:40.146431 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:40.146433 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:40.146516 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.146518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.147589 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.147590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.148879 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.148881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.149643 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149645 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.149722 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.149735 (+ 13us) client_negotiation.cc:769] Sending connection context
0806 15:11:40.149807 (+ 72us) client_negotiation.cc:240] Negotiation successful
0806 15:11:40.149861 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":78,"threads_started":1}
I20260806 15:11:40.149945 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.146061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51290 (local address 127.29.69.130:33861)
0806 15:11:40.146211 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.146216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.146228 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:11:40.146269 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.146271 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.146288 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.146407 (+ 119us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:40.146635 (+ 228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.147480 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.148964 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.149548 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149632 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.149727 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.149822 (+ 95us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.149861 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":81,"threads_started":1}
I20260806 15:11:40.150247 18171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.145962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52032 (local address 127.29.69.131:42941)
0806 15:11:40.146387 (+ 425us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.146391 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.146401 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:11:40.146436 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.146438 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.146452 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.146541 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:40.146745 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.147848 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149065 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.149781 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149854 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.149940 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.150136 (+ 196us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.150176 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381,"thread_start_us":101,"threads_started":1}
I20260806 15:11:40.150254 18173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.146102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40709 (local address 127.0.0.1:59736)
0806 15:11:40.146516 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.146526 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:40.146630 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:40.146889 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:40.146890 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:40.146891 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:40.146928 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.146929 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.148139 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.148140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.149083 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.149085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.150021 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.150022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.150074 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.150078 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:40.150125 (+ 47us) client_negotiation.cc:240] Negotiation successful
0806 15:11:40.150158 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":72,"threads_started":1}
I20260806 15:11:40.150552 18174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.146339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59736 (local address 127.29.69.129:40709)
0806 15:11:40.146573 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.146578 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.146589 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:11:40.146734 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.146738 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.146753 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.146823 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:40.147019 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.148063 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149168 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.149861 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149919 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.149993 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.150386 (+ 393us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.150438 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":197,"thread_start_us":100,"threads_started":1}
I20260806 15:11:40.150254 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.145873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:42941 (local address 127.0.0.1:52032)
0806 15:11:40.146223 (+ 350us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.146233 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:40.146273 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:40.146613 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:40.146614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:40.146616 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:40.146665 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.146666 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.147942 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.147943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.148975 (+ 1032us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.148977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.149977 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.149978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.150055 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.150058 (+ 3us) client_negotiation.cc:769] Sending connection context
0806 15:11:40.150118 (+ 60us) client_negotiation.cc:240] Negotiation successful
0806 15:11:40.150160 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"mutex_wait_us":2,"spinlock_wait_cycles":384,"thread_start_us":92,"threads_started":1}
I20260806 15:11:40.151100 17961 tablet_service.cc:1467] Processing CreateTablet for tablet 78cca0750c7444db8b82749ed50a7e80 (DEFAULT_TABLE table=test-table [id=e96da7799bd04a5796c031da956d5969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:40.151250 18094 tablet_service.cc:1467] Processing CreateTablet for tablet 78cca0750c7444db8b82749ed50a7e80 (DEFAULT_TABLE table=test-table [id=e96da7799bd04a5796c031da956d5969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:40.151240 17829 tablet_service.cc:1467] Processing CreateTablet for tablet 78cca0750c7444db8b82749ed50a7e80 (DEFAULT_TABLE table=test-table [id=e96da7799bd04a5796c031da956d5969]), partition=RANGE (key) PARTITION UNBOUNDED
I20260806 15:11:40.151500 17961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78cca0750c7444db8b82749ed50a7e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:40.151538 18094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78cca0750c7444db8b82749ed50a7e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:40.151631 17829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78cca0750c7444db8b82749ed50a7e80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:40.154193 18175 tablet_bootstrap.cc:492] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: Bootstrap starting.
I20260806 15:11:40.154844 18176 tablet_bootstrap.cc:492] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Bootstrap starting.
I20260806 15:11:40.154932 18175 tablet_bootstrap.cc:654] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:40.155295 18175 log.cc:824] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:40.155565 18176 tablet_bootstrap.cc:654] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:40.155897 18176 log.cc:824] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:40.156114 18175 tablet_bootstrap.cc:492] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: No bootstrap required, opened a new log
I20260806 15:11:40.156195 18175 ts_tablet_manager.cc:1397] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:40.156239 18178 tablet_bootstrap.cc:492] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Bootstrap starting.
I20260806 15:11:40.156596 18176 tablet_bootstrap.cc:492] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: No bootstrap required, opened a new log
I20260806 15:11:40.156677 18176 ts_tablet_manager.cc:1397] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:40.156905 18178 tablet_bootstrap.cc:654] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:40.157240 18178 log.cc:824] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:40.158089 18178 tablet_bootstrap.cc:492] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: No bootstrap required, opened a new log
I20260806 15:11:40.158162 18178 ts_tablet_manager.cc:1397] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260806 15:11:40.158764 18175 raft_consensus.cc:348] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.158981 18175 raft_consensus.cc:374] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:40.159034 18175 raft_consensus.cc:729] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8499526f4b14ec48ed1b1143a1e6601, State: Initialized, Role: FOLLOWER
I20260806 15:11:40.159143 18175 consensus_queue.cc:260] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.159443 18175 ts_tablet_manager.cc:1428] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 15:11:40.159457 17895 heartbeater.cc:503] Master 127.29.69.190:46219 was elected leader, sending a full tablet report...
I20260806 15:11:40.159410 18176 raft_consensus.cc:348] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.159552 18176 raft_consensus.cc:374] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:40.159590 18176 raft_consensus.cc:729] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f26713b85c0f4d54bacf66ea84bdaf4a, State: Initialized, Role: FOLLOWER
I20260806 15:11:40.159696 18176 consensus_queue.cc:260] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.159938 18176 ts_tablet_manager.cc:1428] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260806 15:11:40.160076 18161 heartbeater.cc:503] Master 127.29.69.190:46219 was elected leader, sending a full tablet report...
I20260806 15:11:40.160784 18178 raft_consensus.cc:348] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.160981 18178 raft_consensus.cc:374] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:40.161020 18178 raft_consensus.cc:729] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac593f9d5e88428e90e642ff0734ed3a, State: Initialized, Role: FOLLOWER
I20260806 15:11:40.161134 18178 consensus_queue.cc:260] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.161494 18178 ts_tablet_manager.cc:1428] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260806 15:11:40.161542 18028 heartbeater.cc:503] Master 127.29.69.190:46219 was elected leader, sending a full tablet report...
W20260806 15:11:40.242110 18029 tablet.cc:2369] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:11:40.334896 18184 raft_consensus.cc:482] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:40.335021 18184 raft_consensus.cc:504] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.335453 18184 leader_election.cc:288] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f26713b85c0f4d54bacf66ea84bdaf4a (127.29.69.131:42941), d8499526f4b14ec48ed1b1143a1e6601 (127.29.69.129:40709)
I20260806 15:11:40.338558 18171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.335736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:47809 (local address 127.29.69.131:42941)
0806 15:11:40.335785 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.335787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.335798 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:11:40.335898 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.335899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.335909 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.335988 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:40.336154 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.336768 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.337818 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.338186 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.338272 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.338281 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.338447 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.338484 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260806 15:11:40.338558 18030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.335644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.131:42941 (local address 127.29.69.130:47809)
0806 15:11:40.335713 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.335728 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:40.335795 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:40.335991 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:40.335993 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:40.335994 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:40.336078 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.336080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.336849 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.336850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.337735 (+ 885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.337738 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.338271 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.338272 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.338364 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.338370 (+ 6us) client_negotiation.cc:769] Sending connection context
0806 15:11:40.338441 (+ 71us) client_negotiation.cc:240] Negotiation successful
0806 15:11:40.338484 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260806 15:11:40.338631 18174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.335879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.29.69.130:45907 (local address 127.29.69.129:40709)
0806 15:11:40.335946 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.335948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.335993 (+ 45us) server_negotiation.cc:407] Connection header received
0806 15:11:40.336104 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.336105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.336117 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.336195 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0806 15:11:40.336367 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.336853 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.337847 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.338219 (+ 372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.338311 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.338351 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.338515 (+ 164us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.338556 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260806 15:11:40.338692 18185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.335790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40709 (local address 127.29.69.130:45907)
0806 15:11:40.335934 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.335945 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:11:40.336019 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:11:40.336201 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:11:40.336202 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:11:40.336204 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0806 15:11:40.336289 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.336291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.336954 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.336955 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.337750 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:11:40.337753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.338336 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.338337 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:11:40.338423 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.338427 (+ 4us) client_negotiation.cc:769] Sending connection context
0806 15:11:40.338507 (+ 80us) client_negotiation.cc:240] Negotiation successful
0806 15:11:40.338553 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":95,"threads_started":1}
I20260806 15:11:40.339373 17849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78cca0750c7444db8b82749ed50a7e80" candidate_uuid: "ac593f9d5e88428e90e642ff0734ed3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8499526f4b14ec48ed1b1143a1e6601" is_pre_election: true
I20260806 15:11:40.339418 18115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78cca0750c7444db8b82749ed50a7e80" candidate_uuid: "ac593f9d5e88428e90e642ff0734ed3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" is_pre_election: true
I20260806 15:11:40.339529 17849 raft_consensus.cc:2454] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac593f9d5e88428e90e642ff0734ed3a in term 0.
I20260806 15:11:40.339612 18115 raft_consensus.cc:2454] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac593f9d5e88428e90e642ff0734ed3a in term 0.
I20260806 15:11:40.339773 17915 leader_election.cc:302] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac593f9d5e88428e90e642ff0734ed3a, d8499526f4b14ec48ed1b1143a1e6601; no voters:
I20260806 15:11:40.339929 18184 raft_consensus.cc:2781] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260806 15:11:40.340000 18184 raft_consensus.cc:482] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260806 15:11:40.340018 18184 raft_consensus.cc:3037] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:40.340761 18184 raft_consensus.cc:504] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.340898 18184 leader_election.cc:288] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [CANDIDATE]: Term 1 election: Requested vote from peers f26713b85c0f4d54bacf66ea84bdaf4a (127.29.69.131:42941), d8499526f4b14ec48ed1b1143a1e6601 (127.29.69.129:40709)
I20260806 15:11:40.341094 18115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78cca0750c7444db8b82749ed50a7e80" candidate_uuid: "ac593f9d5e88428e90e642ff0734ed3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a"
I20260806 15:11:40.341141 17849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78cca0750c7444db8b82749ed50a7e80" candidate_uuid: "ac593f9d5e88428e90e642ff0734ed3a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8499526f4b14ec48ed1b1143a1e6601"
I20260806 15:11:40.341172 18115 raft_consensus.cc:3037] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:40.341248 17849 raft_consensus.cc:3037] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:40.341938 18115 raft_consensus.cc:2454] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac593f9d5e88428e90e642ff0734ed3a in term 1.
I20260806 15:11:40.342099 17915 leader_election.cc:302] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac593f9d5e88428e90e642ff0734ed3a, f26713b85c0f4d54bacf66ea84bdaf4a; no voters:
I20260806 15:11:40.342128 17849 raft_consensus.cc:2454] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac593f9d5e88428e90e642ff0734ed3a in term 1.
I20260806 15:11:40.342195 18184 raft_consensus.cc:2781] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:40.342412 18184 raft_consensus.cc:686] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 1 LEADER]: Becoming Leader. State: Replica: ac593f9d5e88428e90e642ff0734ed3a, State: Running, Role: LEADER
I20260806 15:11:40.342541 18184 consensus_queue.cc:237] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } }
I20260806 15:11:40.343456 17706 catalog_manager.cc:5495] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a reported cstate change: term changed from 0 to 1, leader changed from <none> to ac593f9d5e88428e90e642ff0734ed3a (127.29.69.130). New cstate: current_term: 1 leader_uuid: "ac593f9d5e88428e90e642ff0734ed3a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac593f9d5e88428e90e642ff0734ed3a" member_type: VOTER last_known_addr { host: "127.29.69.130" port: 33861 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 } health_report { overall_health: UNKNOWN } } }
W20260806 15:11:40.368322 18162 tablet.cc:2369] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260806 15:11:40.370726 17896 tablet.cc:2369] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260806 15:11:40.374890 18172 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.372577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.29.69.130:33861)
0806 15:11:40.372623 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:40.372625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:40.372633 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:11:40.372701 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:40.372702 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:40.372719 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:40.372776 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:11:40.372925 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.373421 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.374208 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:40.374446 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:40.374502 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:40.374624 (+ 122us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:11:40.374716 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:11:40.374771 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:40.374803 (+ 32us) server_negotiation.cc:299] Negotiation successful
0806 15:11:40.374820 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:11:40.376622 17849 raft_consensus.cc:1261] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 1 FOLLOWER]: Refusing update from remote peer ac593f9d5e88428e90e642ff0734ed3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:40.376660 18115 raft_consensus.cc:1261] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 1 FOLLOWER]: Refusing update from remote peer ac593f9d5e88428e90e642ff0734ed3a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:11:40.376986 18184 consensus_queue.cc:1035] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8499526f4b14ec48ed1b1143a1e6601" member_type: VOTER last_known_addr { host: "127.29.69.129" port: 40709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:40.377146 18186 consensus_queue.cc:1035] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f26713b85c0f4d54bacf66ea84bdaf4a" member_type: VOTER last_known_addr { host: "127.29.69.131" port: 42941 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:11:40.379365 18189 mvcc.cc:205] Tried to move back new op lower bound from 7315575195140104192 to 7315575195003637760. Current Snapshot: MvccSnapshot[applied={T|T < 7315575195140104192}]
I20260806 15:11:40.380882 18192 mvcc.cc:205] Tried to move back new op lower bound from 7315575195140104192 to 7315575195003637760. Current Snapshot: MvccSnapshot[applied={T|T < 7315575195140104192}]
I20260806 15:11:40.381405 17705 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:40.381502 17705 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53500:
table { table_name: "test-table" } modify_external_catalogs: true
I20260806 15:11:40.382334 17705 catalog_manager.cc:5782] T 00000000000000000000000000000000 P adac5c5c2a6948dabe68de2df094568f: Sending DeleteTablet for 3 replicas of tablet 78cca0750c7444db8b82749ed50a7e80
I20260806 15:11:40.382682 18094 tablet_service.cc:1514] Processing DeleteTablet for tablet 78cca0750c7444db8b82749ed50a7e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:40 UTC) from {username='slave'} at 127.0.0.1:52032
I20260806 15:11:40.382682 17961 tablet_service.cc:1514] Processing DeleteTablet for tablet 78cca0750c7444db8b82749ed50a7e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:40 UTC) from {username='slave'} at 127.0.0.1:51290
I20260806 15:11:40.382694 17829 tablet_service.cc:1514] Processing DeleteTablet for tablet 78cca0750c7444db8b82749ed50a7e80 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-06 15:11:40 UTC) from {username='slave'} at 127.0.0.1:59736
I20260806 15:11:40.382962 18200 tablet_replica.cc:330] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601: stopping tablet replica
I20260806 15:11:40.382951 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17766
I20260806 15:11:40.383086 18200 raft_consensus.cc:2229] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:40.383206 18200 raft_consensus.cc:2258] T 78cca0750c7444db8b82749ed50a7e80 P d8499526f4b14ec48ed1b1143a1e6601 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:40.386439 18198 tablet_replica.cc:330] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: stopping tablet replica
I20260806 15:11:40.386613 18198 raft_consensus.cc:2229] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260806 15:11:40.386742 18198 raft_consensus.cc:2258] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:40.386971 18199 tablet_replica.cc:330] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: stopping tablet replica
I20260806 15:11:40.387097 18199 raft_consensus.cc:2229] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 1 LEADER]: Raft consensus shutting down.
I20260806 15:11:40.387372 18198 ts_tablet_manager.cc:1905] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:40.387629 18199 raft_consensus.cc:2258] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260806 15:11:40.389603 18199 ts_tablet_manager.cc:1905] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260806 15:11:40.391309 18199 ts_tablet_manager.cc:1918] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:40.391383 18199 log.cc:1196] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-1/wal/wals/78cca0750c7444db8b82749ed50a7e80
I20260806 15:11:40.391662 18199 ts_tablet_manager.cc:1939] T 78cca0750c7444db8b82749ed50a7e80 P ac593f9d5e88428e90e642ff0734ed3a: Deleting consensus metadata
I20260806 15:11:40.392071 17690 catalog_manager.cc:4841] TS ac593f9d5e88428e90e642ff0734ed3a (127.29.69.130:33861): tablet 78cca0750c7444db8b82749ed50a7e80 (table test-table [id=e96da7799bd04a5796c031da956d5969]) successfully deleted
W20260806 15:11:40.395183 17692 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.29.69.129:40709 (error 108)
I20260806 15:11:40.395444 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17898
I20260806 15:11:40.396136 18198 ts_tablet_manager.cc:1918] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260806 15:11:40.396234 18198 log.cc:1196] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Deleting WAL directory at /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786028857624334-29974-0/minicluster-data/ts-2/wal/wals/78cca0750c7444db8b82749ed50a7e80
I20260806 15:11:40.396484 18198 ts_tablet_manager.cc:1939] T 78cca0750c7444db8b82749ed50a7e80 P f26713b85c0f4d54bacf66ea84bdaf4a: Deleting consensus metadata
I20260806 15:11:40.396914 17692 catalog_manager.cc:4841] TS f26713b85c0f4d54bacf66ea84bdaf4a (127.29.69.131:42941): tablet 78cca0750c7444db8b82749ed50a7e80 (table test-table [id=e96da7799bd04a5796c031da956d5969]) successfully deleted
I20260806 15:11:40.398741 18169 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:40.398589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.129:40709 (local address 127.0.0.1:59744)
0806 15:11:40.398657 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 15:11:40.398709 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.129:40709: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260806 15:11:40.398895 17692 catalog_manager.cc:4584] TS d8499526f4b14ec48ed1b1143a1e6601 (127.29.69.129:40709): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 78cca0750c7444db8b82749ed50a7e80: Network error: Client connection negotiation failed: client connection to 127.29.69.129:40709: connect: Connection refused (error 111)
I20260806 15:11:40.401799 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18031
I20260806 15:11:40.407948 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 17675
2026-08-06T15:11:40Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (843 ms)
[----------] 6 tests from EncryptionPolicyTest (8103 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:40 dist-test-slave-tm1g krb5kdc[18204](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:40 dist-test-slave-tm1g krb5kdc[18204](info): set up 2 sockets
Aug 06 15:11:40 dist-test-slave-tm1g krb5kdc[18204](info): commencing operation
krb5kdc: starting...
W20260806 15:11:41.462939 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:41 dist-test-slave-tm1g krb5kdc[18204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:41Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:41.577602 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36999
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36999
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:41.658473 18217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:41.658708 18217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:41.658746 18217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:41.659870 18217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:41.659942 18217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:41.659968 18217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:41.659991 18217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:41.660027 18217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:41.661497 18217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36999
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36999
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:41.661777 18217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:41.662000 18217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:41.666703 18226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:41.666728 18224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:41.666771 18222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:41.666901 18217 server_base.cc:1034] running on GCE node
I20260806 15:11:41.667181 18217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:41.667505 18217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:41.668669 18217 hybrid_clock.cc:648] HybridClock initialized: now 1786029101668657 us; error 44 us; skew 500 ppm
Aug 06 15:11:41 dist-test-slave-tm1g krb5kdc[18204](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029101, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:41.671068 18217 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:41.671515 18217 webserver.cc:460] Webserver started at http://127.0.0.1:45799/ using document root <none> and password file <none>
I20260806 15:11:41.671761 18217 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:41.671806 18217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:41.671895 18217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:41.672865 18217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "032e9926e98b46cbb53538b9514a3f6c"
format_stamp: "Formatted at 2026-08-06 15:11:41 on dist-test-slave-tm1g"
server_key: "a975fb32abdd22dfa095056aa24e7ab4"
server_key_iv: "b7554759796808f465fdbdc102da216d"
server_key_version: "encryptionkey@0"
I20260806 15:11:41.673173 18217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "032e9926e98b46cbb53538b9514a3f6c"
format_stamp: "Formatted at 2026-08-06 15:11:41 on dist-test-slave-tm1g"
server_key: "a975fb32abdd22dfa095056aa24e7ab4"
server_key_iv: "b7554759796808f465fdbdc102da216d"
server_key_version: "encryptionkey@0"
I20260806 15:11:41.674533 18217 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:41.675300 18234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:41.675534 18217 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:41.675660 18217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "032e9926e98b46cbb53538b9514a3f6c"
format_stamp: "Formatted at 2026-08-06 15:11:41 on dist-test-slave-tm1g"
server_key: "a975fb32abdd22dfa095056aa24e7ab4"
server_key_iv: "b7554759796808f465fdbdc102da216d"
server_key_version: "encryptionkey@0"
I20260806 15:11:41.675736 18217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:41.701200 18217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:41.703791 18217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:41.703970 18217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:41.708316 18217 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36999
I20260806 15:11:41.708369 18289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36999 every 8 connection(s)
I20260806 15:11:41.708737 18217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:41.709700 18290 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:41.711925 18290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c: Bootstrap starting.
I20260806 15:11:41.712402 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18217
I20260806 15:11:41.712517 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:41.712594 18290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:41.712720 29974 external_mini_cluster.cc:1428] Setting key 835fd11881f708f58abf2f408864509e
I20260806 15:11:41.712929 18290 log.cc:824] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:41.713713 18290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c: No bootstrap required, opened a new log
I20260806 15:11:41.716046 18290 raft_consensus.cc:348] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032e9926e98b46cbb53538b9514a3f6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36999 } }
I20260806 15:11:41.716212 18290 raft_consensus.cc:374] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:41.716248 18290 raft_consensus.cc:729] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 032e9926e98b46cbb53538b9514a3f6c, State: Initialized, Role: FOLLOWER
I20260806 15:11:41.716385 18290 consensus_queue.cc:260] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032e9926e98b46cbb53538b9514a3f6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36999 } }
I20260806 15:11:41.716461 18290 raft_consensus.cc:388] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:41.716490 18290 raft_consensus.cc:482] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:41.716526 18290 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:41.717145 18290 raft_consensus.cc:504] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032e9926e98b46cbb53538b9514a3f6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36999 } }
I20260806 15:11:41.717234 18290 leader_election.cc:302] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 032e9926e98b46cbb53538b9514a3f6c; no voters:
I20260806 15:11:41.717440 18290 leader_election.cc:288] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:41.717463 18295 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:41.717571 18295 raft_consensus.cc:686] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [term 1 LEADER]: Becoming Leader. State: Replica: 032e9926e98b46cbb53538b9514a3f6c, State: Running, Role: LEADER
I20260806 15:11:41.717715 18295 consensus_queue.cc:237] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032e9926e98b46cbb53538b9514a3f6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36999 } }
I20260806 15:11:41.717703 18290 sys_catalog.cc:564] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:41.718039 18295 sys_catalog.cc:455] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 032e9926e98b46cbb53538b9514a3f6c. Latest consensus state: current_term: 1 leader_uuid: "032e9926e98b46cbb53538b9514a3f6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032e9926e98b46cbb53538b9514a3f6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36999 } } }
I20260806 15:11:41.718107 18295 sys_catalog.cc:458] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [sys.catalog]: This master's current role is: LEADER
W20260806 15:11:41.719798 18311 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 15:11:41.719558 18297 sys_catalog.cc:455] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "032e9926e98b46cbb53538b9514a3f6c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "032e9926e98b46cbb53538b9514a3f6c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36999 } } }
W20260806 15:11:41.719859 18311 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:11:41.719877 18297 sys_catalog.cc:458] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:41.719915 18299 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:41.720089 18299 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 15:11:41 dist-test-slave-tm1g krb5kdc[18204](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 15:11:41.721650 18299 catalog_manager.cc:1347] Generated new cluster ID: 8bd1915a44224c6b9cfc9154459c4dd7
I20260806 15:11:41.721706 18299 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:41.725418 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:41.713249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46735 (local address 127.0.0.1:36999)
0806 15:11:41.713455 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:41.713464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:41.713499 (+ 35us) server_negotiation.cc:407] Connection header received
0806 15:11:41.713993 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:41.713999 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:41.714046 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:41.714157 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:41.715008 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:41.715850 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:41.716932 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:41.717475 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:41.717659 (+ 184us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:41.720811 (+ 3152us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:41.720815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:41.720815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:41.720829 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:41.723007 (+ 2178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:41.723579 (+ 572us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:41.723582 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:41.723583 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:41.723693 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:41.723970 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:41.723971 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:41.723971 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:41.724301 (+ 330us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:41.724487 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:41.725031 (+ 544us) server_negotiation.cc:299] Negotiation successful
0806 15:11:41.725146 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":82,"threads_started":1}
I20260806 15:11:41.726918 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:41.736048 18294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:41.728572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35383 (local address 127.0.0.1:36999)
0806 15:11:41.728608 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:41.728610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:41.728618 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:11:41.728643 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:41.728643 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:41.728653 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:41.728719 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:41.729306 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:41.730153 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:41.731136 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:41.731515 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:41.731595 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:41.732920 (+ 1325us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:41.732922 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:41.732922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:41.732930 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:41.734775 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:41.735182 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:41.735184 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:41.735184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:41.735248 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:41.735488 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:41.735489 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:41.735489 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:41.735629 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:41.735756 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:41.735880 (+ 124us) server_negotiation.cc:299] Negotiation successful
0806 15:11:41.735949 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:11:41.736923 18299 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:41.737672 18299 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:41.745584 18299 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 032e9926e98b46cbb53538b9514a3f6c: Generated new TSK 0
I20260806 15:11:41.745771 18299 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:41.751438 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18217
W20260806 15:11:41.756516 18202 connection.cc:535] client connection to 127.0.0.1:36999 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36999): Connection reset by peer (error 104)
2026-08-06T15:11:41Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1342 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:41 dist-test-slave-tm1g krb5kdc[18321](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:41 dist-test-slave-tm1g krb5kdc[18321](info): set up 2 sockets
Aug 06 15:11:41 dist-test-slave-tm1g krb5kdc[18321](info): commencing operation
krb5kdc: starting...
W20260806 15:11:42.833082 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.063s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:42 dist-test-slave-tm1g krb5kdc[18321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029102, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:42.951471 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35081
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35081
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:43.030972 18336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:43.031213 18336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:43.031251 18336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:43.032397 18336 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:43.032462 18336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:43.032485 18336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:43.032505 18336 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:43.032537 18336 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:43.034025 18336 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35081
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:43.034314 18336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:43.034539 18336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:43.039314 18344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:43.039352 18342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:43.039525 18336 server_base.cc:1034] running on GCE node
W20260806 15:11:43.039361 18341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:43.039817 18336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:43.040146 18336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:43.041342 18336 hybrid_clock.cc:648] HybridClock initialized: now 1786029103041316 us; error 38 us; skew 500 ppm
Aug 06 15:11:43 dist-test-slave-tm1g krb5kdc[18321](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029103, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:43.043866 18336 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:43.044292 18336 webserver.cc:460] Webserver started at http://127.0.0.1:44487/ using document root <none> and password file <none>
I20260806 15:11:43.044531 18336 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:43.044602 18336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:43.044755 18336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:43.045851 18336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "2f593e65f8684625aa7810281375050b"
format_stamp: "Formatted at 2026-08-06 15:11:43 on dist-test-slave-tm1g"
server_key: "0445c15435a9d3f6e3bbab446bee5ea2"
server_key_iv: "e01c12b337c260352b4c583edf7da9e8"
server_key_version: "encryptionkey@0"
I20260806 15:11:43.046224 18336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "2f593e65f8684625aa7810281375050b"
format_stamp: "Formatted at 2026-08-06 15:11:43 on dist-test-slave-tm1g"
server_key: "0445c15435a9d3f6e3bbab446bee5ea2"
server_key_iv: "e01c12b337c260352b4c583edf7da9e8"
server_key_version: "encryptionkey@0"
I20260806 15:11:43.047595 18336 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:43.048317 18351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:43.048482 18336 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:43.048584 18336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "2f593e65f8684625aa7810281375050b"
format_stamp: "Formatted at 2026-08-06 15:11:43 on dist-test-slave-tm1g"
server_key: "0445c15435a9d3f6e3bbab446bee5ea2"
server_key_iv: "e01c12b337c260352b4c583edf7da9e8"
server_key_version: "encryptionkey@0"
I20260806 15:11:43.048667 18336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:43.073695 18336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:43.076064 18336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:43.076228 18336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:43.080345 18336 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35081
I20260806 15:11:43.080381 18406 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35081 every 8 connection(s)
I20260806 15:11:43.080760 18336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:43.081715 18407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:43.084062 18407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b: Bootstrap starting.
I20260806 15:11:43.084726 18407 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:43.085037 18407 log.cc:824] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:43.085847 18407 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b: No bootstrap required, opened a new log
I20260806 15:11:43.086011 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18336
I20260806 15:11:43.086125 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:43.086329 29974 external_mini_cluster.cc:1428] Setting key 2e6feb7e1f83f9dcc991816e41c47488
I20260806 15:11:43.088260 18407 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f593e65f8684625aa7810281375050b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35081 } }
I20260806 15:11:43.088397 18407 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:43.088426 18407 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2f593e65f8684625aa7810281375050b, State: Initialized, Role: FOLLOWER
I20260806 15:11:43.088560 18407 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f593e65f8684625aa7810281375050b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35081 } }
I20260806 15:11:43.088632 18407 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:43.088672 18407 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:43.088723 18407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:43.089285 18407 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f593e65f8684625aa7810281375050b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35081 } }
I20260806 15:11:43.089375 18407 leader_election.cc:302] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2f593e65f8684625aa7810281375050b; no voters:
I20260806 15:11:43.089609 18407 leader_election.cc:288] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:43.089654 18412 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:43.089828 18412 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [term 1 LEADER]: Becoming Leader. State: Replica: 2f593e65f8684625aa7810281375050b, State: Running, Role: LEADER
I20260806 15:11:43.089932 18407 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:43.090054 18412 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f593e65f8684625aa7810281375050b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35081 } }
I20260806 15:11:43.090550 18413 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2f593e65f8684625aa7810281375050b. Latest consensus state: current_term: 1 leader_uuid: "2f593e65f8684625aa7810281375050b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f593e65f8684625aa7810281375050b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35081 } } }
I20260806 15:11:43.090510 18414 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2f593e65f8684625aa7810281375050b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2f593e65f8684625aa7810281375050b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35081 } } }
I20260806 15:11:43.090648 18413 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:43.090958 18420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:43.091676 18420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:43.090672 18414 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:43.093699 18411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:43.086894 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37299 (local address 127.0.0.1:35081)
0806 15:11:43.087099 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:43.087107 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:43.087141 (+ 34us) server_negotiation.cc:407] Connection header received
0806 15:11:43.087734 (+ 593us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:43.087741 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:43.087786 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:43.087897 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:43.088153 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:43.089515 (+ 1362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:43.090729 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:43.091426 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:43.091541 (+ 115us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:43.092672 (+ 1131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:43.092676 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:43.092676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:43.093057 (+ 381us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:43.093099 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:43.093114 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:43.093208 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:43.093365 (+ 157us) server_negotiation.cc:299] Negotiation successful
0806 15:11:43.093395 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260806 15:11:43.094228 18420 catalog_manager.cc:1347] Generated new cluster ID: 1634f6813b2643d1bd01c98ccc30be2c
I20260806 15:11:43.094281 18420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:43.094724 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:43.099010 18411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:43.096109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57647 (local address 127.0.0.1:35081)
0806 15:11:43.096152 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:43.096154 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:43.096271 (+ 117us) server_negotiation.cc:407] Connection header received
0806 15:11:43.096334 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:43.096335 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:43.096345 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:43.096400 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:43.096546 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:43.097032 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:43.097757 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:43.097987 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:43.098068 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:43.098771 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:43.098773 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:43.098773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:43.098777 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:43.098791 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:43.098795 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:43.098848 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:43.098907 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 15:11:43.098916 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:11:43.121307 18420 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:43.121927 18420 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:43.124857 18420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2f593e65f8684625aa7810281375050b: Generated new TSK 0
I20260806 15:11:43.125052 18420 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:43.135538 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18336
W20260806 15:11:43.140611 18319 connection.cc:535] client connection to 127.0.0.1:35081 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:35081): Connection reset by peer (error 104)
2026-08-06T15:11:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1384 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:43 dist-test-slave-tm1g krb5kdc[18438](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:43 dist-test-slave-tm1g krb5kdc[18438](info): set up 2 sockets
Aug 06 15:11:43 dist-test-slave-tm1g krb5kdc[18438](info): commencing operation
krb5kdc: starting...
W20260806 15:11:44.218598 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:44 dist-test-slave-tm1g krb5kdc[18438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029104, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:44.336822 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41141
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41141
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:44.417032 18451 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:44.417264 18451 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:44.417303 18451 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:44.418512 18451 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:44.418571 18451 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:44.418598 18451 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:44.418642 18451 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:44.418664 18451 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:44.420130 18451 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41141
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41141
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18451
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:44.420393 18451 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:44.420624 18451 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:44.425462 18457 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:44.425437 18456 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:44.425474 18459 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:44.425994 18451 server_base.cc:1034] running on GCE node
I20260806 15:11:44.426215 18451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:44.426566 18451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:44.427762 18451 hybrid_clock.cc:648] HybridClock initialized: now 1786029104427732 us; error 33 us; skew 500 ppm
Aug 06 15:11:44 dist-test-slave-tm1g krb5kdc[18438](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029104, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:44.430199 18451 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:44.430692 18451 webserver.cc:460] Webserver started at http://127.0.0.1:42493/ using document root <none> and password file <none>
I20260806 15:11:44.430946 18451 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:44.430991 18451 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:44.431154 18451 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:44.432178 18451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43"
format_stamp: "Formatted at 2026-08-06 15:11:44 on dist-test-slave-tm1g"
server_key: "ebaf82e6bbf50abf2bc15c81a142a5bb"
server_key_iv: "9b5e195e768ab167d3d86156e00f8b2e"
server_key_version: "encryptionkey@0"
I20260806 15:11:44.432554 18451 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43"
format_stamp: "Formatted at 2026-08-06 15:11:44 on dist-test-slave-tm1g"
server_key: "ebaf82e6bbf50abf2bc15c81a142a5bb"
server_key_iv: "9b5e195e768ab167d3d86156e00f8b2e"
server_key_version: "encryptionkey@0"
I20260806 15:11:44.433826 18451 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:44.434568 18466 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:44.434737 18451 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:44.434845 18451 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43"
format_stamp: "Formatted at 2026-08-06 15:11:44 on dist-test-slave-tm1g"
server_key: "ebaf82e6bbf50abf2bc15c81a142a5bb"
server_key_iv: "9b5e195e768ab167d3d86156e00f8b2e"
server_key_version: "encryptionkey@0"
I20260806 15:11:44.434921 18451 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:44.438087 18451 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:44.440043 18451 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:44.440202 18451 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:44.444295 18451 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41141
I20260806 15:11:44.444327 18518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41141 every 8 connection(s)
I20260806 15:11:44.444643 18451 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:44.445650 18519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:44.447932 18519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43: Bootstrap starting.
I20260806 15:11:44.448448 18519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:44.448690 18519 log.cc:824] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:44.449486 18519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43: No bootstrap required, opened a new log
I20260806 15:11:44.451085 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18451
I20260806 15:11:44.451222 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:44.451117 18519 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41141 } }
I20260806 15:11:44.451316 18519 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:44.451370 18519 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc8ba98ed26b44ad95c62b30f9ec7b43, State: Initialized, Role: FOLLOWER
I20260806 15:11:44.451435 29974 external_mini_cluster.cc:1428] Setting key c185a8cc91df209501eb76ab8b688f91
I20260806 15:11:44.451527 18519 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41141 } }
I20260806 15:11:44.451615 18519 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:44.451650 18519 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:44.451705 18519 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:44.452875 18519 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41141 } }
I20260806 15:11:44.453001 18519 leader_election.cc:302] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc8ba98ed26b44ad95c62b30f9ec7b43; no voters:
I20260806 15:11:44.453177 18519 leader_election.cc:288] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:44.453214 18524 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:44.453389 18524 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [term 1 LEADER]: Becoming Leader. State: Replica: cc8ba98ed26b44ad95c62b30f9ec7b43, State: Running, Role: LEADER
I20260806 15:11:44.453444 18519 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:44.453568 18524 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41141 } }
I20260806 15:11:44.453753 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:44.451950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54211 (local address 127.0.0.1:41141)
0806 15:11:44.452161 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:44.452170 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:44.452209 (+ 39us) server_negotiation.cc:407] Connection header received
0806 15:11:44.452368 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:44.452377 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:44.452414 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:44.452558 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:44.453164 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:44.453167 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:44.453167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:44.453172 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:44.453218 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:44.453233 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:44.453359 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:44.453529 (+ 170us) server_negotiation.cc:299] Negotiation successful
0806 15:11:44.453572 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":93,"threads_started":1}
I20260806 15:11:44.453935 18526 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc8ba98ed26b44ad95c62b30f9ec7b43. Latest consensus state: current_term: 1 leader_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41141 } } }
I20260806 15:11:44.454053 18526 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:44.454329 18533 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:44.454701 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:44.454851 18533 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:44.454999 18525 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc8ba98ed26b44ad95c62b30f9ec7b43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41141 } } }
I20260806 15:11:44.455056 18525 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:44.456333 18533 catalog_manager.cc:1347] Generated new cluster ID: fbf776d2468b4d0597aa8c6dca97ff08
I20260806 15:11:44.456395 18533 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:44.459442 18523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:44.456057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57381 (local address 127.0.0.1:41141)
0806 15:11:44.456114 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:44.456115 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:44.458451 (+ 2336us) server_negotiation.cc:407] Connection header received
0806 15:11:44.458542 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:44.458542 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:44.458548 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:44.458574 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:44.459167 (+ 593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:44.459169 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:44.459169 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:44.459174 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:44.459189 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:44.459194 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:44.459260 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:44.459312 (+ 52us) server_negotiation.cc:299] Negotiation successful
0806 15:11:44.459324 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:11:44.466754 18533 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:44.466908 18533 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:44.470834 18533 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc8ba98ed26b44ad95c62b30f9ec7b43: Generated new TSK 0
I20260806 15:11:44.471004 18533 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:44.475598 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18451
2026-08-06T15:11:44Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1339 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:44 dist-test-slave-tm1g krb5kdc[18553](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:44 dist-test-slave-tm1g krb5kdc[18553](info): set up 2 sockets
Aug 06 15:11:44 dist-test-slave-tm1g krb5kdc[18553](info): commencing operation
krb5kdc: starting...
W20260806 15:11:45.531183 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.037s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:45 dist-test-slave-tm1g krb5kdc[18553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:45.653775 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43789
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:37971
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43789
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:45.734328 18566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:45.734562 18566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:45.734612 18566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:45.735755 18566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:45.735826 18566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:45.735853 18566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:45.735885 18566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:45.735910 18566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:45.737373 18566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:37971
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43789
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43789
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:45.737640 18566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:45.737872 18566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:45.744012 18574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:45.744014 18572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:45.744241 18571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:45.744510 18566 server_base.cc:1034] running on GCE node
I20260806 15:11:45.744764 18566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:45.745157 18566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:45.746330 18566 hybrid_clock.cc:648] HybridClock initialized: now 1786029105746284 us; error 34 us; skew 500 ppm
Aug 06 15:11:45 dist-test-slave-tm1g krb5kdc[18553](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029105, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:45.749567 18566 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:45.750012 18566 webserver.cc:460] Webserver started at http://127.0.0.1:40213/ using document root <none> and password file <none>
I20260806 15:11:45.750283 18566 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:45.750382 18566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:45.750528 18566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:45.751653 18566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "c47827b00db844c5be6f97ccfaf652db"
format_stamp: "Formatted at 2026-08-06 15:11:45 on dist-test-slave-tm1g"
server_key: "2659f1705913f0557fa7a43510403f48"
server_key_iv: "eeb74ec9afc21c2ce60bea8b728b6e4d"
server_key_version: "encryptionkey@0"
I20260806 15:11:45.752033 18566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "c47827b00db844c5be6f97ccfaf652db"
format_stamp: "Formatted at 2026-08-06 15:11:45 on dist-test-slave-tm1g"
server_key: "2659f1705913f0557fa7a43510403f48"
server_key_iv: "eeb74ec9afc21c2ce60bea8b728b6e4d"
server_key_version: "encryptionkey@0"
I20260806 15:11:45.753422 18566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:45.754189 18581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:45.754402 18566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:45.754511 18566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "c47827b00db844c5be6f97ccfaf652db"
format_stamp: "Formatted at 2026-08-06 15:11:45 on dist-test-slave-tm1g"
server_key: "2659f1705913f0557fa7a43510403f48"
server_key_iv: "eeb74ec9afc21c2ce60bea8b728b6e4d"
server_key_version: "encryptionkey@0"
I20260806 15:11:45.754621 18566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:45.767765 18566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:45.770124 18566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:45.770289 18566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:45.774279 18566 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43789
I20260806 15:11:45.774358 18633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43789 every 8 connection(s)
I20260806 15:11:45.774757 18566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:45.775686 18634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:45.777964 18634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db: Bootstrap starting.
I20260806 15:11:45.778652 18634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:45.778831 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18566
I20260806 15:11:45.778965 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:45.778998 18634 log.cc:824] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:45.779171 29974 external_mini_cluster.cc:1428] Setting key 0c73db5a7339da7f558d8e1f3a6a1562
I20260806 15:11:45.779945 18634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db: No bootstrap required, opened a new log
I20260806 15:11:45.782876 18634 raft_consensus.cc:348] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47827b00db844c5be6f97ccfaf652db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43789 } }
I20260806 15:11:45.783039 18634 raft_consensus.cc:374] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:45.783106 18634 raft_consensus.cc:729] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c47827b00db844c5be6f97ccfaf652db, State: Initialized, Role: FOLLOWER
I20260806 15:11:45.783294 18634 consensus_queue.cc:260] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47827b00db844c5be6f97ccfaf652db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43789 } }
I20260806 15:11:45.783442 18634 raft_consensus.cc:388] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:45.783525 18634 raft_consensus.cc:482] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:45.783607 18634 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:45.784327 18634 raft_consensus.cc:504] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47827b00db844c5be6f97ccfaf652db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43789 } }
I20260806 15:11:45.784449 18634 leader_election.cc:302] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c47827b00db844c5be6f97ccfaf652db; no voters:
I20260806 15:11:45.784649 18634 leader_election.cc:288] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:45.784678 18639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:45.784830 18639 raft_consensus.cc:686] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [term 1 LEADER]: Becoming Leader. State: Replica: c47827b00db844c5be6f97ccfaf652db, State: Running, Role: LEADER
I20260806 15:11:45.784912 18634 sys_catalog.cc:564] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:45.784927 18639 consensus_queue.cc:237] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47827b00db844c5be6f97ccfaf652db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43789 } }
I20260806 15:11:45.785544 18640 sys_catalog.cc:455] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c47827b00db844c5be6f97ccfaf652db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47827b00db844c5be6f97ccfaf652db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43789 } } }
I20260806 15:11:45.785645 18640 sys_catalog.cc:458] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:45.785737 18641 sys_catalog.cc:455] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [sys.catalog]: SysCatalogTable state changed. Reason: New leader c47827b00db844c5be6f97ccfaf652db. Latest consensus state: current_term: 1 leader_uuid: "c47827b00db844c5be6f97ccfaf652db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c47827b00db844c5be6f97ccfaf652db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43789 } } }
I20260806 15:11:45.785867 18643 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:45.785877 18641 sys_catalog.cc:458] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:45.786373 18643 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 15:11:45 dist-test-slave-tm1g krb5kdc[18553](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029105, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 15:11:45.789465 18643 catalog_manager.cc:1347] Generated new cluster ID: 68c7d161a29d411e975a76ac0728e674
I20260806 15:11:45.789521 18643 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:45.793325 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:45.779750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60701 (local address 127.0.0.1:43789)
0806 15:11:45.779923 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:45.779932 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:45.779967 (+ 35us) server_negotiation.cc:407] Connection header received
0806 15:11:45.780425 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:45.780431 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:45.780479 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:45.780596 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:45.781387 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:45.783093 (+ 1706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:45.784194 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:45.784882 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:45.784994 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:45.789087 (+ 4093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:45.789090 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:45.789090 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:45.789102 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:45.791276 (+ 2174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:45.791708 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:45.791711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:45.791711 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:45.791815 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:45.792045 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:45.792047 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:45.792047 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:45.792348 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:45.792517 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:45.792954 (+ 437us) server_negotiation.cc:299] Negotiation successful
0806 15:11:45.793102 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":93,"threads_started":1}
I20260806 15:11:45.794287 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:45.800879 18643 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:45.801548 18643 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:45.804214 18643 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c47827b00db844c5be6f97ccfaf652db: Generated new TSK 0
I20260806 15:11:45.804401 18643 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:45.807554 18638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:45.798601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54785 (local address 127.0.0.1:43789)
0806 15:11:45.798639 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:45.798641 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:45.800560 (+ 1919us) server_negotiation.cc:407] Connection header received
0806 15:11:45.800596 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:45.800597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:45.800608 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:45.800670 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:45.801371 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:45.802131 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:45.803115 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:45.803465 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:45.803537 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:45.804977 (+ 1440us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:45.804978 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:45.804978 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:45.804983 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:45.806509 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:45.806884 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:45.806885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:45.806885 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:45.806936 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:45.807128 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:45.807129 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:45.807129 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:45.807222 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:45.807293 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:45.807434 (+ 141us) server_negotiation.cc:299] Negotiation successful
0806 15:11:45.807498 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:11:45.809495 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18566
2026-08-06T15:11:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1334 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:45 dist-test-slave-tm1g krb5kdc[18665](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:45 dist-test-slave-tm1g krb5kdc[18665](info): set up 2 sockets
Aug 06 15:11:45 dist-test-slave-tm1g krb5kdc[18665](info): commencing operation
krb5kdc: starting...
W20260806 15:11:46.858847 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:46 dist-test-slave-tm1g krb5kdc[18665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:46.977777 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39727
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38737
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39727
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:47.057987 18678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:47.058185 18678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:47.058207 18678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:47.059293 18678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:47.059327 18678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:47.059341 18678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:47.059355 18678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:47.059366 18678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:47.060748 18678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38737
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39727
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39727
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:47.060935 18678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:47.061108 18678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:47.065701 18687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:47.065718 18685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:47.065711 18683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:47.065913 18678 server_base.cc:1034] running on GCE node
I20260806 15:11:47.066150 18678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:47.066534 18678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:47.067705 18678 hybrid_clock.cc:648] HybridClock initialized: now 1786029107067684 us; error 35 us; skew 500 ppm
Aug 06 15:11:47 dist-test-slave-tm1g krb5kdc[18665](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029107, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:47.074702 18678 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:47.075152 18678 webserver.cc:460] Webserver started at http://127.0.0.1:38859/ using document root <none> and password file <none>
I20260806 15:11:47.075344 18678 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:47.075385 18678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:47.075481 18678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:47.076470 18678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "731c8410ae1d4e8da86a2813d53bc2e4"
format_stamp: "Formatted at 2026-08-06 15:11:47 on dist-test-slave-tm1g"
server_key: "dd77570c55cd6fad4c65ce2164d758a9"
server_key_iv: "e6dcb6340e3767d9325ad4f45c176973"
server_key_version: "encryptionkey@0"
I20260806 15:11:47.076763 18678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "731c8410ae1d4e8da86a2813d53bc2e4"
format_stamp: "Formatted at 2026-08-06 15:11:47 on dist-test-slave-tm1g"
server_key: "dd77570c55cd6fad4c65ce2164d758a9"
server_key_iv: "e6dcb6340e3767d9325ad4f45c176973"
server_key_version: "encryptionkey@0"
I20260806 15:11:47.078019 18678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260806 15:11:47.078843 18696 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:47.079051 18678 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260806 15:11:47.079145 18678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "731c8410ae1d4e8da86a2813d53bc2e4"
format_stamp: "Formatted at 2026-08-06 15:11:47 on dist-test-slave-tm1g"
server_key: "dd77570c55cd6fad4c65ce2164d758a9"
server_key_iv: "e6dcb6340e3767d9325ad4f45c176973"
server_key_version: "encryptionkey@0"
I20260806 15:11:47.079200 18678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:47.097822 18678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:47.100046 18678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:47.100167 18678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:47.104132 18678 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39727
I20260806 15:11:47.104216 18748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39727 every 8 connection(s)
I20260806 15:11:47.104547 18678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:47.105536 18749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:47.107842 18749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4: Bootstrap starting.
I20260806 15:11:47.108436 18749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:47.108731 18749 log.cc:824] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:47.109457 18749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4: No bootstrap required, opened a new log
I20260806 15:11:47.111044 18749 raft_consensus.cc:348] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260806 15:11:47.111205 18749 raft_consensus.cc:374] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:47.111254 18749 raft_consensus.cc:729] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 731c8410ae1d4e8da86a2813d53bc2e4, State: Initialized, Role: FOLLOWER
I20260806 15:11:47.111403 18749 consensus_queue.cc:260] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260806 15:11:47.111487 18749 raft_consensus.cc:388] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:47.111532 18749 raft_consensus.cc:482] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:47.111585 18749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:47.112097 18749 raft_consensus.cc:504] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260806 15:11:47.112216 18749 leader_election.cc:302] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 731c8410ae1d4e8da86a2813d53bc2e4; no voters:
I20260806 15:11:47.112394 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18678
I20260806 15:11:47.112440 18749 leader_election.cc:288] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:47.112468 18752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:47.112529 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:47.112629 18752 raft_consensus.cc:686] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [term 1 LEADER]: Becoming Leader. State: Replica: 731c8410ae1d4e8da86a2813d53bc2e4, State: Running, Role: LEADER
I20260806 15:11:47.112692 18749 sys_catalog.cc:564] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:47.112706 18752 consensus_queue.cc:237] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } }
I20260806 15:11:47.112751 29974 external_mini_cluster.cc:1428] Setting key f75d7d267fe74587664fe40b4efd7283
I20260806 15:11:47.113026 18752 sys_catalog.cc:455] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 731c8410ae1d4e8da86a2813d53bc2e4. Latest consensus state: current_term: 1 leader_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } } }
I20260806 15:11:47.113194 18752 sys_catalog.cc:458] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:47.113457 18762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:47.113529 18754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "731c8410ae1d4e8da86a2813d53bc2e4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39727 } } }
I20260806 15:11:47.113682 18754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:47.114236 18762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:47.115845 18762 catalog_manager.cc:1347] Generated new cluster ID: 4e3cda6399f84333bc899192de8714a5
I20260806 15:11:47.116328 18762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:47.118949 18763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:47.113378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33585 (local address 127.0.0.1:39727)
0806 15:11:47.113761 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:47.113771 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:47.114187 (+ 416us) server_negotiation.cc:407] Connection header received
0806 15:11:47.114342 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:47.114350 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:47.114402 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:47.114538 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:47.114833 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:47.116070 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:47.116957 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:47.117460 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:47.117585 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:47.118274 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:47.118278 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:47.118278 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:47.118485 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:47.118515 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:47.118527 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:47.118606 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:47.118682 (+ 76us) server_negotiation.cc:299] Negotiation successful
0806 15:11:47.118749 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":331,"thread_start_us":80,"threads_started":1}
I20260806 15:11:47.119874 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:47.124603 18762 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:47.125267 18762 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:47.126809 18763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:47.121188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59923 (local address 127.0.0.1:39727)
0806 15:11:47.121226 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:47.121228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:47.122497 (+ 1269us) server_negotiation.cc:407] Connection header received
0806 15:11:47.122574 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:47.122575 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:47.122585 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:47.122642 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:47.122757 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:47.123245 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:47.123959 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:47.124206 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:47.124277 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:47.126515 (+ 2238us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:47.126516 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:47.126516 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:47.126522 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:47.126536 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:47.126540 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:47.126614 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:47.126673 (+ 59us) server_negotiation.cc:299] Negotiation successful
0806 15:11:47.126712 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:11:47.129184 18762 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 731c8410ae1d4e8da86a2813d53bc2e4: Generated new TSK 0
I20260806 15:11:47.129345 18762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:47.133195 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18678
2026-08-06T15:11:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:47 dist-test-slave-tm1g krb5kdc[18780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:47 dist-test-slave-tm1g krb5kdc[18780](info): set up 2 sockets
Aug 06 15:11:47 dist-test-slave-tm1g krb5kdc[18780](info): commencing operation
krb5kdc: starting...
W20260806 15:11:48.182822 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.002s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:48 dist-test-slave-tm1g krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:48.303521 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42389
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33631
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42389
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:48.384212 18793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:48.384418 18793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:48.384441 18793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:48.385528 18793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:48.385561 18793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:48.385576 18793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:48.385588 18793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:48.385600 18793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:48.387017 18793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33631
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42389
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42389
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:48.387215 18793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:48.387404 18793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:48.392540 18798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:48.392582 18799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:48.392565 18801 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:48.392866 18793 server_base.cc:1034] running on GCE node
I20260806 15:11:48.393175 18793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:48.393482 18793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:48.394659 18793 hybrid_clock.cc:648] HybridClock initialized: now 1786029108394625 us; error 58 us; skew 500 ppm
Aug 06 15:11:48 dist-test-slave-tm1g krb5kdc[18780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029108, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:48.397302 18793 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:48.397805 18793 webserver.cc:460] Webserver started at http://127.0.0.1:46781/ using document root <none> and password file <none>
I20260806 15:11:48.398057 18793 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:48.398129 18793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:48.398276 18793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:48.399374 18793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "8d4186c43b174befbdbf89fc2958ec66"
format_stamp: "Formatted at 2026-08-06 15:11:48 on dist-test-slave-tm1g"
server_key: "46f55101699c1ab97e97daa039313bc6"
server_key_iv: "5a074dff99fe0c9c2b3efa51abea36cb"
server_key_version: "encryptionkey@0"
I20260806 15:11:48.399748 18793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "8d4186c43b174befbdbf89fc2958ec66"
format_stamp: "Formatted at 2026-08-06 15:11:48 on dist-test-slave-tm1g"
server_key: "46f55101699c1ab97e97daa039313bc6"
server_key_iv: "5a074dff99fe0c9c2b3efa51abea36cb"
server_key_version: "encryptionkey@0"
I20260806 15:11:48.401104 18793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:48.401831 18808 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:48.402024 18793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260806 15:11:48.402127 18793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "8d4186c43b174befbdbf89fc2958ec66"
format_stamp: "Formatted at 2026-08-06 15:11:48 on dist-test-slave-tm1g"
server_key: "46f55101699c1ab97e97daa039313bc6"
server_key_iv: "5a074dff99fe0c9c2b3efa51abea36cb"
server_key_version: "encryptionkey@0"
I20260806 15:11:48.402215 18793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:48.405486 18793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:48.407452 18793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:48.407629 18793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:48.411964 18793 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42389
I20260806 15:11:48.411994 18862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42389 every 8 connection(s)
I20260806 15:11:48.412432 18793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:48.413470 18863 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:48.415746 18863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66: Bootstrap starting.
I20260806 15:11:48.416327 18863 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:48.416611 18863 log.cc:824] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:48.417400 18863 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66: No bootstrap required, opened a new log
I20260806 15:11:48.418347 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18793
I20260806 15:11:48.418504 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:48.418684 29974 external_mini_cluster.cc:1428] Setting key 6cdf7b2b43b6309354bdf08a131b11ec
I20260806 15:11:48.420111 18863 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d4186c43b174befbdbf89fc2958ec66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42389 } }
I20260806 15:11:48.420310 18863 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:48.420398 18863 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d4186c43b174befbdbf89fc2958ec66, State: Initialized, Role: FOLLOWER
I20260806 15:11:48.420554 18863 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d4186c43b174befbdbf89fc2958ec66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42389 } }
I20260806 15:11:48.420671 18863 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:48.420706 18863 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:48.420789 18863 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:48.421556 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:48.419221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48683 (local address 127.0.0.1:42389)
0806 15:11:48.419807 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:48.419817 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:48.419868 (+ 51us) server_negotiation.cc:407] Connection header received
0806 15:11:48.420065 (+ 197us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:48.420072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:48.420103 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:48.420242 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:48.421084 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:48.421089 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:48.421090 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:48.421095 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:48.421150 (+ 55us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:48.421170 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:48.421247 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:48.421304 (+ 57us) server_negotiation.cc:299] Negotiation successful
0806 15:11:48.421346 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":524,"thread_start_us":89,"threads_started":1}
I20260806 15:11:48.421831 18863 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d4186c43b174befbdbf89fc2958ec66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42389 } }
I20260806 15:11:48.421955 18863 leader_election.cc:302] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d4186c43b174befbdbf89fc2958ec66; no voters:
I20260806 15:11:48.422140 18863 leader_election.cc:288] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:48.422168 18868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:48.422327 18868 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [term 1 LEADER]: Becoming Leader. State: Replica: 8d4186c43b174befbdbf89fc2958ec66, State: Running, Role: LEADER
I20260806 15:11:48.422441 18863 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:48.422482 18868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d4186c43b174befbdbf89fc2958ec66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42389 } }
I20260806 15:11:48.422660 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:48.422811 18868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d4186c43b174befbdbf89fc2958ec66. Latest consensus state: current_term: 1 leader_uuid: "8d4186c43b174befbdbf89fc2958ec66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d4186c43b174befbdbf89fc2958ec66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42389 } } }
I20260806 15:11:48.422890 18868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:48.422827 18869 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d4186c43b174befbdbf89fc2958ec66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d4186c43b174befbdbf89fc2958ec66" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42389 } } }
I20260806 15:11:48.423060 18869 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66 [sys.catalog]: This master's current role is: LEADER
W20260806 15:11:48.424226 18885 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:11:48.424328 18885 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:11:48.424470 18874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:48.424659 18874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:48.426035 18867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:48.424606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54037 (local address 127.0.0.1:42389)
0806 15:11:48.424665 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:48.424667 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:48.424801 (+ 134us) server_negotiation.cc:407] Connection header received
0806 15:11:48.424908 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:48.424909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:48.424914 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:48.424944 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:48.425634 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:48.425635 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:48.425636 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:48.425640 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:48.425653 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:48.425657 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:48.425720 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:48.425958 (+ 238us) server_negotiation.cc:299] Negotiation successful
0806 15:11:48.425974 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:11:48.426414 18874 catalog_manager.cc:1347] Generated new cluster ID: d8ab8126dce0432e9a764188410cfe9d
I20260806 15:11:48.426465 18874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:48.461364 18874 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:48.461565 18874 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:48.464421 18874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8d4186c43b174befbdbf89fc2958ec66: Generated new TSK 0
I20260806 15:11:48.464602 18874 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:48.475445 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18793
2026-08-06T15:11:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1342 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:48 dist-test-slave-tm1g krb5kdc[18894](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:48 dist-test-slave-tm1g krb5kdc[18894](info): set up 2 sockets
Aug 06 15:11:48 dist-test-slave-tm1g krb5kdc[18894](info): commencing operation
krb5kdc: starting...
W20260806 15:11:49.522835 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:49 dist-test-slave-tm1g krb5kdc[18894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:49.647292 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39343
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40711
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39343
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:49.728819 18908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:49.729033 18908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:49.729056 18908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:49.730123 18908 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:49.730159 18908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:49.730173 18908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:49.730186 18908 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:49.730198 18908 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:49.731714 18908 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40711
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18908
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:49.731935 18908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:49.732108 18908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:49.737136 18916 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:49.737129 18913 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:49.737309 18908 server_base.cc:1034] running on GCE node
W20260806 15:11:49.737138 18914 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:49.737648 18908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:49.737962 18908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:49.739151 18908 hybrid_clock.cc:648] HybridClock initialized: now 1786029109739136 us; error 31 us; skew 500 ppm
Aug 06 15:11:49 dist-test-slave-tm1g krb5kdc[18894](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029109, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:49.742998 18908 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:49.743608 18908 webserver.cc:460] Webserver started at http://127.0.0.1:38927/ using document root <none> and password file <none>
I20260806 15:11:49.743865 18908 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:49.743983 18908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:49.744127 18908 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:49.745527 18908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "dfd7dbdb721d480e887a5eaadec09678"
format_stamp: "Formatted at 2026-08-06 15:11:49 on dist-test-slave-tm1g"
server_key: "328d3d51bd5be4feac07fc4c4525acca"
server_key_iv: "6e945735db3fcf4949f69e273dda147e"
server_key_version: "encryptionkey@0"
I20260806 15:11:49.745959 18908 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "dfd7dbdb721d480e887a5eaadec09678"
format_stamp: "Formatted at 2026-08-06 15:11:49 on dist-test-slave-tm1g"
server_key: "328d3d51bd5be4feac07fc4c4525acca"
server_key_iv: "6e945735db3fcf4949f69e273dda147e"
server_key_version: "encryptionkey@0"
I20260806 15:11:49.747659 18908 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:11:49.748736 18923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:49.748934 18908 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:49.749042 18908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "dfd7dbdb721d480e887a5eaadec09678"
format_stamp: "Formatted at 2026-08-06 15:11:49 on dist-test-slave-tm1g"
server_key: "328d3d51bd5be4feac07fc4c4525acca"
server_key_iv: "6e945735db3fcf4949f69e273dda147e"
server_key_version: "encryptionkey@0"
I20260806 15:11:49.749132 18908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:49.779786 18908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:49.782023 18908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:49.782222 18908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:49.786197 18908 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39343
I20260806 15:11:49.786253 18978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39343 every 8 connection(s)
I20260806 15:11:49.786628 18908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:49.787523 18979 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:49.789774 18979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678: Bootstrap starting.
I20260806 15:11:49.790388 18979 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:49.790640 18979 log.cc:824] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:49.791325 18979 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678: No bootstrap required, opened a new log
I20260806 15:11:49.792671 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 18908
I20260806 15:11:49.792799 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:49.792991 29974 external_mini_cluster.cc:1428] Setting key 18a7177b9771ced4862dd6666f0f86e0
I20260806 15:11:49.793015 18979 raft_consensus.cc:348] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd7dbdb721d480e887a5eaadec09678" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39343 } }
I20260806 15:11:49.793222 18979 raft_consensus.cc:374] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:49.793277 18979 raft_consensus.cc:729] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dfd7dbdb721d480e887a5eaadec09678, State: Initialized, Role: FOLLOWER
I20260806 15:11:49.793666 18979 consensus_queue.cc:260] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd7dbdb721d480e887a5eaadec09678" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39343 } }
I20260806 15:11:49.793776 18979 raft_consensus.cc:388] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:49.793828 18979 raft_consensus.cc:482] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:49.793882 18979 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:49.795128 18979 raft_consensus.cc:504] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd7dbdb721d480e887a5eaadec09678" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39343 } }
I20260806 15:11:49.795254 18979 leader_election.cc:302] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dfd7dbdb721d480e887a5eaadec09678; no voters:
I20260806 15:11:49.795449 18979 leader_election.cc:288] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:49.795517 18984 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:49.795670 18984 raft_consensus.cc:686] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [term 1 LEADER]: Becoming Leader. State: Replica: dfd7dbdb721d480e887a5eaadec09678, State: Running, Role: LEADER
I20260806 15:11:49.795756 18979 sys_catalog.cc:564] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:49.795753 18984 consensus_queue.cc:237] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd7dbdb721d480e887a5eaadec09678" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39343 } }
I20260806 15:11:49.796130 18984 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dfd7dbdb721d480e887a5eaadec09678. Latest consensus state: current_term: 1 leader_uuid: "dfd7dbdb721d480e887a5eaadec09678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd7dbdb721d480e887a5eaadec09678" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39343 } } }
I20260806 15:11:49.796134 18986 sys_catalog.cc:455] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dfd7dbdb721d480e887a5eaadec09678" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dfd7dbdb721d480e887a5eaadec09678" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39343 } } }
I20260806 15:11:49.796207 18984 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:49.796258 18986 sys_catalog.cc:458] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:49.796463 18989 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:49.797221 18989 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 06 15:11:49 dist-test-slave-tm1g krb5kdc[18894](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029109, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 15:11:49.802958 18989 catalog_manager.cc:1347] Generated new cluster ID: ea081e80b2a24218882008ec36328233
I20260806 15:11:49.803033 18989 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:49.804560 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:49.793501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:38205 (local address 127.0.0.1:39343)
0806 15:11:49.793678 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:49.793686 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:49.793714 (+ 28us) server_negotiation.cc:407] Connection header received
0806 15:11:49.793854 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:49.793862 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:49.793927 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:49.794081 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:49.794945 (+ 864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:49.796262 (+ 1317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:49.797471 (+ 1209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:49.798068 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:49.798177 (+ 109us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:49.800799 (+ 2622us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:49.800802 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:49.800803 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:49.800814 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:49.802690 (+ 1876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:49.803169 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:49.803173 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:49.803173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:49.803288 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:49.803553 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:49.803554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:49.803554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:49.803853 (+ 299us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:49.803992 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:49.804170 (+ 178us) server_negotiation.cc:299] Negotiation successful
0806 15:11:49.804370 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":105,"threads_started":1}
I20260806 15:11:49.805495 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:49.817644 18983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:49.806923 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:36629 (local address 127.0.0.1:39343)
0806 15:11:49.806955 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:49.806957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:49.810529 (+ 3572us) server_negotiation.cc:407] Connection header received
0806 15:11:49.810589 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:49.810590 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:49.810600 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:49.810649 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:49.811273 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:49.812000 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:49.813081 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:49.813391 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:49.813451 (+ 60us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:49.814903 (+ 1452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:49.814905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:49.814905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:49.814911 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:49.816425 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:49.816844 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:49.816845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:49.816846 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:49.816899 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:49.817128 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:49.817128 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:49.817129 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:49.817243 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:49.817331 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:49.817492 (+ 161us) server_negotiation.cc:299] Negotiation successful
0806 15:11:49.817553 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":16}
I20260806 15:11:49.820554 18989 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:49.821170 18989 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:49.836320 18989 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dfd7dbdb721d480e887a5eaadec09678: Generated new TSK 0
I20260806 15:11:49.836531 18989 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:49.838923 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 18908
W20260806 15:11:49.844492 18892 connection.cc:535] client connection to 127.0.0.1:39343 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39343): Connection reset by peer (error 104)
2026-08-06T15:11:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1364 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:49 dist-test-slave-tm1g krb5kdc[19011](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:49 dist-test-slave-tm1g krb5kdc[19011](info): set up 2 sockets
Aug 06 15:11:49 dist-test-slave-tm1g krb5kdc[19011](info): commencing operation
krb5kdc: starting...
W20260806 15:11:50.900825 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.042s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:50 dist-test-slave-tm1g krb5kdc[19011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029110, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:51.025401 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43523
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39087
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43523
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:51.107489 19025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:51.107741 19025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:51.107782 19025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:51.108960 19025 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:51.109035 19025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:51.109061 19025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:51.109089 19025 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:51.109120 19025 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:51.110682 19025 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39087
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43523
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43523
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:51.110963 19025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:51.111200 19025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:51.116102 19033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:51.116230 19025 server_base.cc:1034] running on GCE node
W20260806 15:11:51.116133 19031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:51.116123 19030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:51.116587 19025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:51.116904 19025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:51.118103 19025 hybrid_clock.cc:648] HybridClock initialized: now 1786029111118097 us; error 37 us; skew 500 ppm
Aug 06 15:11:51 dist-test-slave-tm1g krb5kdc[19011](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029111, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:51.120718 19025 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:51.121201 19025 webserver.cc:460] Webserver started at http://127.0.0.1:45625/ using document root <none> and password file <none>
I20260806 15:11:51.121469 19025 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:51.121541 19025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:51.121690 19025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:51.122819 19025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "f2121221fdaa4eaf95c75ee5e002119e"
format_stamp: "Formatted at 2026-08-06 15:11:51 on dist-test-slave-tm1g"
server_key: "1e79e3b53d2277a444f8ca91d775acec"
server_key_iv: "7aa9b2d1d7e81bc0d91457370173e300"
server_key_version: "encryptionkey@0"
I20260806 15:11:51.123179 19025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "f2121221fdaa4eaf95c75ee5e002119e"
format_stamp: "Formatted at 2026-08-06 15:11:51 on dist-test-slave-tm1g"
server_key: "1e79e3b53d2277a444f8ca91d775acec"
server_key_iv: "7aa9b2d1d7e81bc0d91457370173e300"
server_key_version: "encryptionkey@0"
I20260806 15:11:51.124526 19025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:51.125288 19040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:51.125491 19025 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:51.125597 19025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "f2121221fdaa4eaf95c75ee5e002119e"
format_stamp: "Formatted at 2026-08-06 15:11:51 on dist-test-slave-tm1g"
server_key: "1e79e3b53d2277a444f8ca91d775acec"
server_key_iv: "7aa9b2d1d7e81bc0d91457370173e300"
server_key_version: "encryptionkey@0"
I20260806 15:11:51.125671 19025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:51.151654 19025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:51.153578 19025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:51.153748 19025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:51.158041 19025 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43523
I20260806 15:11:51.158134 19095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43523 every 8 connection(s)
I20260806 15:11:51.158511 19025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:51.159411 19096 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:51.160624 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19025
I20260806 15:11:51.160753 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:51.160944 29974 external_mini_cluster.cc:1428] Setting key 3453c99f17085d8e6ed2e0bbfd5f86c6
I20260806 15:11:51.162217 19096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e: Bootstrap starting.
I20260806 15:11:51.162930 19096 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:51.163240 19096 log.cc:824] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:51.164076 19096 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e: No bootstrap required, opened a new log
I20260806 15:11:51.166468 19096 raft_consensus.cc:348] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } }
I20260806 15:11:51.166612 19096 raft_consensus.cc:374] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:51.166635 19096 raft_consensus.cc:729] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2121221fdaa4eaf95c75ee5e002119e, State: Initialized, Role: FOLLOWER
I20260806 15:11:51.166708 19099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:51.161468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:43481 (local address 127.0.0.1:43523)
0806 15:11:51.161646 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:51.161655 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:51.161689 (+ 34us) server_negotiation.cc:407] Connection header received
0806 15:11:51.162105 (+ 416us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:51.162112 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:51.162159 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:51.162274 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:51.162550 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:51.163633 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:51.164742 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:51.165163 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:51.165246 (+ 83us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:51.165989 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:51.165993 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:51.165993 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:51.166154 (+ 161us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:51.166190 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:51.166200 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:51.166267 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:51.166404 (+ 137us) server_negotiation.cc:299] Negotiation successful
0806 15:11:51.166452 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":96,"threads_started":1}
I20260806 15:11:51.166852 19096 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } }
I20260806 15:11:51.166970 19101 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260806 15:11:51.167241 19101 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } }
I20260806 15:11:51.167342 19101 leader_election.cc:302] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2121221fdaa4eaf95c75ee5e002119e; no voters:
I20260806 15:11:51.166949 19096 raft_consensus.cc:388] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:51.167450 19096 raft_consensus.cc:482] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:51.167491 19096 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:51.167876 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:51.168264 19096 raft_consensus.cc:504] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } }
I20260806 15:11:51.168363 19096 leader_election.cc:302] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2121221fdaa4eaf95c75ee5e002119e; no voters:
I20260806 15:11:51.168396 19102 raft_consensus.cc:2741] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260806 15:11:51.168499 19096 leader_election.cc:288] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:51.167526 19101 leader_election.cc:288] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers
I20260806 15:11:51.168588 19103 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:51.168730 19103 raft_consensus.cc:686] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [term 1 LEADER]: Becoming Leader. State: Replica: f2121221fdaa4eaf95c75ee5e002119e, State: Running, Role: LEADER
I20260806 15:11:51.168766 19096 sys_catalog.cc:564] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:51.168815 19103 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } }
I20260806 15:11:51.169173 19103 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2121221fdaa4eaf95c75ee5e002119e. Latest consensus state: current_term: 1 leader_uuid: "f2121221fdaa4eaf95c75ee5e002119e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } } }
I20260806 15:11:51.169169 19101 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2121221fdaa4eaf95c75ee5e002119e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2121221fdaa4eaf95c75ee5e002119e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43523 } } }
I20260806 15:11:51.169374 19101 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:51.169586 19103 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:51.170156 19115 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:51.170739 19115 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:51.172448 19115 catalog_manager.cc:1347] Generated new cluster ID: 5fae5df4abff4214a5db728ff6bfd763
I20260806 15:11:51.172504 19115 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:51.173066 19099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:51.169391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:58433 (local address 127.0.0.1:43523)
0806 15:11:51.169428 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:51.169430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:51.169634 (+ 204us) server_negotiation.cc:407] Connection header received
0806 15:11:51.169742 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:51.169744 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:51.169756 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:51.169817 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:51.169985 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:51.170706 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:51.171700 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:51.171928 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:51.172023 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:51.172782 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:51.172784 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:51.172784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:51.172788 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:51.172807 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:51.172813 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:51.172882 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:51.172985 (+ 103us) server_negotiation.cc:299] Negotiation successful
0806 15:11:51.172997 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:11:51.184590 19115 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:51.185114 19115 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:51.189211 19115 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f2121221fdaa4eaf95c75ee5e002119e: Generated new TSK 0
I20260806 15:11:51.189417 19115 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:51.196877 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19025
W20260806 15:11:51.202420 19009 connection.cc:535] client connection to 127.0.0.1:43523 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43523): Connection reset by peer (error 104)
2026-08-06T15:11:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1357 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:51 dist-test-slave-tm1g krb5kdc[19129](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:51 dist-test-slave-tm1g krb5kdc[19129](info): set up 2 sockets
Aug 06 15:11:51 dist-test-slave-tm1g krb5kdc[19129](info): commencing operation
krb5kdc: starting...
W20260806 15:11:52.262902 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:52 dist-test-slave-tm1g krb5kdc[19129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029112, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:52.387137 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33145
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35831
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33145
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:52.469707 19143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:52.469924 19143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:52.469949 19143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:52.471182 19143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:52.471236 19143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:52.471288 19143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:52.471310 19143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:52.471334 19143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:52.472877 19143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35831
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33145
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33145
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:52.473084 19143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:52.473268 19143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:52.478194 19151 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:52.478246 19148 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:52.478432 19143 server_base.cc:1034] running on GCE node
W20260806 15:11:52.478195 19149 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:52.478770 19143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:52.479131 19143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:52.480325 19143 hybrid_clock.cc:648] HybridClock initialized: now 1786029112480311 us; error 43 us; skew 500 ppm
Aug 06 15:11:52 dist-test-slave-tm1g krb5kdc[19129](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029112, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:52.486737 19143 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:52.487236 19143 webserver.cc:460] Webserver started at http://127.0.0.1:32995/ using document root <none> and password file <none>
I20260806 15:11:52.487496 19143 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:52.487567 19143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:52.487716 19143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:52.488812 19143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "64948c3644c0412b8d3615b8a59fe5e6"
format_stamp: "Formatted at 2026-08-06 15:11:52 on dist-test-slave-tm1g"
server_key: "f8c9d3efb1ee7241ee407e6072e3848b"
server_key_iv: "e9330c80a3de72f498b4428206cb3dc2"
server_key_version: "encryptionkey@0"
I20260806 15:11:52.489200 19143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "64948c3644c0412b8d3615b8a59fe5e6"
format_stamp: "Formatted at 2026-08-06 15:11:52 on dist-test-slave-tm1g"
server_key: "f8c9d3efb1ee7241ee407e6072e3848b"
server_key_iv: "e9330c80a3de72f498b4428206cb3dc2"
server_key_version: "encryptionkey@0"
I20260806 15:11:52.490592 19143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:52.491333 19158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:52.491531 19143 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:11:52.491643 19143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "64948c3644c0412b8d3615b8a59fe5e6"
format_stamp: "Formatted at 2026-08-06 15:11:52 on dist-test-slave-tm1g"
server_key: "f8c9d3efb1ee7241ee407e6072e3848b"
server_key_iv: "e9330c80a3de72f498b4428206cb3dc2"
server_key_version: "encryptionkey@0"
I20260806 15:11:52.491719 19143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:52.495071 19143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:52.497349 19143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:52.497511 19143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:52.501578 19143 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33145
I20260806 15:11:52.501609 19210 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33145 every 8 connection(s)
I20260806 15:11:52.501976 19143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:52.502992 19211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:52.505220 19211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6: Bootstrap starting.
I20260806 15:11:52.505869 19211 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:52.506223 19211 log.cc:824] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:52.506971 19211 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6: No bootstrap required, opened a new log
I20260806 15:11:52.508551 19211 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64948c3644c0412b8d3615b8a59fe5e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33145 } }
I20260806 15:11:52.508687 19211 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:52.508708 19211 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64948c3644c0412b8d3615b8a59fe5e6, State: Initialized, Role: FOLLOWER
I20260806 15:11:52.508860 19211 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64948c3644c0412b8d3615b8a59fe5e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33145 } }
I20260806 15:11:52.508922 19211 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:52.508944 19211 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:52.509017 19211 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:52.509545 19211 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64948c3644c0412b8d3615b8a59fe5e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33145 } }
I20260806 15:11:52.509632 19211 leader_election.cc:302] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64948c3644c0412b8d3615b8a59fe5e6; no voters:
I20260806 15:11:52.509815 19211 leader_election.cc:288] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:52.509847 19214 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:52.510015 19214 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [term 1 LEADER]: Becoming Leader. State: Replica: 64948c3644c0412b8d3615b8a59fe5e6, State: Running, Role: LEADER
I20260806 15:11:52.510080 19211 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:52.510154 19214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64948c3644c0412b8d3615b8a59fe5e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33145 } }
I20260806 15:11:52.510563 19216 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64948c3644c0412b8d3615b8a59fe5e6. Latest consensus state: current_term: 1 leader_uuid: "64948c3644c0412b8d3615b8a59fe5e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64948c3644c0412b8d3615b8a59fe5e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33145 } } }
I20260806 15:11:52.510690 19215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64948c3644c0412b8d3615b8a59fe5e6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64948c3644c0412b8d3615b8a59fe5e6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33145 } } }
I20260806 15:11:52.510715 19216 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:52.510777 19215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:52.511123 19223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:52.511652 19223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:52.511991 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19143
I20260806 15:11:52.512112 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:52.512288 29974 external_mini_cluster.cc:1428] Setting key d2e3f9c59bc4586bc46a544a58c9aea1
I20260806 15:11:52.513348 19223 catalog_manager.cc:1347] Generated new cluster ID: cbee6f3f3a094227b418bf4e631627b5
I20260806 15:11:52.513412 19223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:52.517534 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:52.512768 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:39293 (local address 127.0.0.1:33145)
0806 15:11:52.512936 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:52.512945 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:52.516139 (+ 3194us) server_negotiation.cc:407] Connection header received
0806 15:11:52.516259 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:52.516266 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:52.516296 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:52.516436 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:52.517102 (+ 666us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:52.517105 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:52.517106 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:52.517110 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:52.517152 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:52.517166 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:52.517228 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:52.517316 (+ 88us) server_negotiation.cc:299] Negotiation successful
0806 15:11:52.517358 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":93,"threads_started":1}
I20260806 15:11:52.518666 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:52.524122 19223 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:52.524330 19223 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:52.525279 19233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:52.523990 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:45609 (local address 127.0.0.1:33145)
0806 15:11:52.524024 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:52.524026 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:52.524293 (+ 267us) server_negotiation.cc:407] Connection header received
0806 15:11:52.524343 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:52.524344 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:52.524350 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:52.524407 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:52.525068 (+ 661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:52.525069 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:52.525070 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:52.525074 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:52.525089 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:52.525094 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:52.525154 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:52.525204 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 15:11:52.525216 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:11:52.528083 19223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64948c3644c0412b8d3615b8a59fe5e6: Generated new TSK 0
I20260806 15:11:52.528306 19223 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:52.535843 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19143
2026-08-06T15:11:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1338 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:52 dist-test-slave-tm1g krb5kdc[19242](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:52 dist-test-slave-tm1g krb5kdc[19242](info): set up 2 sockets
Aug 06 15:11:52 dist-test-slave-tm1g krb5kdc[19242](info): commencing operation
krb5kdc: starting...
W20260806 15:11:53.587122 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:53 dist-test-slave-tm1g krb5kdc[19242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:53.702651 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45855
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38689
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45855
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:53.785398 19255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:53.785600 19255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:53.785624 19255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:53.786805 19255 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:53.786855 19255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:53.786872 19255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:53.786885 19255 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:53.786897 19255 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:53.788368 19255 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38689
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45855
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45855
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:53.788625 19255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:53.788856 19255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:53.793891 19261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:53.794013 19260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:53.794081 19255 server_base.cc:1034] running on GCE node
W20260806 15:11:53.794031 19263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:53.794427 19255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:53.794757 19255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:53.795934 19255 hybrid_clock.cc:648] HybridClock initialized: now 1786029113795922 us; error 29 us; skew 500 ppm
Aug 06 15:11:53 dist-test-slave-tm1g krb5kdc[19242](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029113, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:53.798707 19255 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:53.799214 19255 webserver.cc:460] Webserver started at http://127.0.0.1:37621/ using document root <none> and password file <none>
I20260806 15:11:53.799443 19255 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:53.799510 19255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:53.799671 19255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:53.800755 19255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "40e157c992d54e6d8214bd18023265a6"
format_stamp: "Formatted at 2026-08-06 15:11:53 on dist-test-slave-tm1g"
server_key: "a049687e2bfe5eb9c801d4464fe46d3c"
server_key_iv: "8839b2cd730c98faab2ca4cdbb74a2de"
server_key_version: "encryptionkey@0"
I20260806 15:11:53.801126 19255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "40e157c992d54e6d8214bd18023265a6"
format_stamp: "Formatted at 2026-08-06 15:11:53 on dist-test-slave-tm1g"
server_key: "a049687e2bfe5eb9c801d4464fe46d3c"
server_key_iv: "8839b2cd730c98faab2ca4cdbb74a2de"
server_key_version: "encryptionkey@0"
I20260806 15:11:53.802562 19255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:11:53.803367 19271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:53.803552 19255 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:53.803659 19255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "40e157c992d54e6d8214bd18023265a6"
format_stamp: "Formatted at 2026-08-06 15:11:53 on dist-test-slave-tm1g"
server_key: "a049687e2bfe5eb9c801d4464fe46d3c"
server_key_iv: "8839b2cd730c98faab2ca4cdbb74a2de"
server_key_version: "encryptionkey@0"
I20260806 15:11:53.803733 19255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:53.824316 19255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:53.826414 19255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:53.826575 19255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:53.830976 19255 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45855
I20260806 15:11:53.831012 19324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45855 every 8 connection(s)
I20260806 15:11:53.831367 19255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:53.832232 19325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:53.834586 19325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6: Bootstrap starting.
I20260806 15:11:53.835139 19325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:53.835381 19325 log.cc:824] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:53.836028 19325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6: No bootstrap required, opened a new log
I20260806 15:11:53.837333 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19255
I20260806 15:11:53.837467 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:53.837658 29974 external_mini_cluster.cc:1428] Setting key 8a63425401d47493e22bfe6c65ce4716
I20260806 15:11:53.837662 19325 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40e157c992d54e6d8214bd18023265a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45855 } }
I20260806 15:11:53.837845 19325 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:53.837888 19325 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e157c992d54e6d8214bd18023265a6, State: Initialized, Role: FOLLOWER
I20260806 15:11:53.838289 19325 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40e157c992d54e6d8214bd18023265a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45855 } }
I20260806 15:11:53.838416 19325 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:53.838450 19325 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:53.838497 19325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:53.839534 19325 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40e157c992d54e6d8214bd18023265a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45855 } }
I20260806 15:11:53.839643 19325 leader_election.cc:302] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40e157c992d54e6d8214bd18023265a6; no voters:
I20260806 15:11:53.839802 19325 leader_election.cc:288] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:53.839851 19330 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:53.839996 19330 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [term 1 LEADER]: Becoming Leader. State: Replica: 40e157c992d54e6d8214bd18023265a6, State: Running, Role: LEADER
I20260806 15:11:53.840044 19325 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:53.840118 19330 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40e157c992d54e6d8214bd18023265a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45855 } }
I20260806 15:11:53.840461 19330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40e157c992d54e6d8214bd18023265a6. Latest consensus state: current_term: 1 leader_uuid: "40e157c992d54e6d8214bd18023265a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40e157c992d54e6d8214bd18023265a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45855 } } }
I20260806 15:11:53.840473 19331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40e157c992d54e6d8214bd18023265a6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40e157c992d54e6d8214bd18023265a6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45855 } } }
I20260806 15:11:53.840626 19330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:53.840633 19331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:53.840906 19339 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:53.841655 19339 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:53.843385 19339 catalog_manager.cc:1347] Generated new cluster ID: 04a1aa7cd4a640ea8c6949cb6ae59b1b
I20260806 15:11:53.843441 19339 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:11:53 dist-test-slave-tm1g krb5kdc[19242](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260806 15:11:53.849530 19329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:53.838139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:51727 (local address 127.0.0.1:45855)
0806 15:11:53.838313 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:53.838323 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:53.838357 (+ 34us) server_negotiation.cc:407] Connection header received
0806 15:11:53.838473 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:53.838480 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:53.838558 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:53.838700 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:53.839298 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:53.840751 (+ 1453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:53.841990 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:53.842502 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:53.842610 (+ 108us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:53.845656 (+ 3046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:53.845660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:53.845661 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:53.845674 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:53.847723 (+ 2049us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:53.848170 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:53.848173 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:53.848173 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:53.848294 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:53.848538 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:53.848540 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:53.848540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:53.848852 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:53.849050 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:53.849142 (+ 92us) server_negotiation.cc:299] Negotiation successful
0806 15:11:53.849274 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":83,"threads_started":1}
I20260806 15:11:53.850517 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:53.859334 19329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:53.852164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:57021 (local address 127.0.0.1:45855)
0806 15:11:53.852204 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:53.852206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:53.852269 (+ 63us) server_negotiation.cc:407] Connection header received
0806 15:11:53.852342 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:53.852343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:53.852352 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:53.852400 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:53.853045 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:53.853776 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:53.854823 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:53.855132 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:53.855193 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:53.856553 (+ 1360us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:53.856554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:53.856554 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:53.856561 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:53.858075 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:53.858536 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:53.858537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:53.858538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:53.858591 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:53.858818 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:53.858819 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:53.858819 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:53.858946 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:53.859033 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:53.859191 (+ 158us) server_negotiation.cc:299] Negotiation successful
0806 15:11:53.859249 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:11:53.862737 19339 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:53.863231 19339 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:53.867919 19339 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40e157c992d54e6d8214bd18023265a6: Generated new TSK 0
I20260806 15:11:53.868091 19339 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:53.870445 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19255
W20260806 15:11:53.875815 19240 connection.cc:535] client connection to 127.0.0.1:45855 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45855): Connection reset by peer (error 104)
2026-08-06T15:11:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1334 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:53 dist-test-slave-tm1g krb5kdc[19356](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:53 dist-test-slave-tm1g krb5kdc[19356](info): set up 2 sockets
Aug 06 15:11:53 dist-test-slave-tm1g krb5kdc[19356](info): commencing operation
krb5kdc: starting...
W20260806 15:11:54.910897 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:54 dist-test-slave-tm1g krb5kdc[19356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029114, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:55.028867 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32941
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33039
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32941
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:55.107661 19369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:55.107901 19369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:55.107939 19369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:55.109120 19369 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:55.109186 19369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:55.109213 19369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:55.109246 19369 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:55.109269 19369 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:55.110723 19369 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33039
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32941
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32941
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19369
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:55.110989 19369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:55.111212 19369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:55.116065 19377 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:55.116083 19375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:55.116063 19374 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:55.116242 19369 server_base.cc:1034] running on GCE node
I20260806 15:11:55.116469 19369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:55.116796 19369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:55.117960 19369 hybrid_clock.cc:648] HybridClock initialized: now 1786029115117955 us; error 35 us; skew 500 ppm
Aug 06 15:11:55 dist-test-slave-tm1g krb5kdc[19356](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029115, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:55.120496 19369 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:55.120945 19369 webserver.cc:460] Webserver started at http://127.0.0.1:41665/ using document root <none> and password file <none>
I20260806 15:11:55.121160 19369 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:55.121227 19369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:55.121378 19369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:55.122473 19369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0"
format_stamp: "Formatted at 2026-08-06 15:11:55 on dist-test-slave-tm1g"
server_key: "90b7de5a060960e0fdcb0590a01df88e"
server_key_iv: "2d6dd9b95bbd25b4d6e779c5bbb0aaf5"
server_key_version: "encryptionkey@0"
I20260806 15:11:55.122830 19369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0"
format_stamp: "Formatted at 2026-08-06 15:11:55 on dist-test-slave-tm1g"
server_key: "90b7de5a060960e0fdcb0590a01df88e"
server_key_iv: "2d6dd9b95bbd25b4d6e779c5bbb0aaf5"
server_key_version: "encryptionkey@0"
I20260806 15:11:55.124154 19369 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:11:55.124979 19384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:55.125190 19369 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:11:55.125308 19369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0"
format_stamp: "Formatted at 2026-08-06 15:11:55 on dist-test-slave-tm1g"
server_key: "90b7de5a060960e0fdcb0590a01df88e"
server_key_iv: "2d6dd9b95bbd25b4d6e779c5bbb0aaf5"
server_key_version: "encryptionkey@0"
I20260806 15:11:55.125415 19369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:55.144563 19369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:55.146883 19369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:55.147045 19369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:55.151157 19369 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32941
I20260806 15:11:55.151198 19439 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32941 every 8 connection(s)
I20260806 15:11:55.151573 19369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:55.152418 19440 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:55.153280 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19369
I20260806 15:11:55.153410 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:55.153620 29974 external_mini_cluster.cc:1428] Setting key ba9df4702c234acad7e12fba8a37d2a4
I20260806 15:11:55.155633 19440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0: Bootstrap starting.
I20260806 15:11:55.156304 19440 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:55.156625 19440 log.cc:824] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:55.157367 19440 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0: No bootstrap required, opened a new log
I20260806 15:11:55.159276 19443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:55.154125 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:54129 (local address 127.0.0.1:32941)
0806 15:11:55.154316 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:55.154324 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:55.154397 (+ 73us) server_negotiation.cc:407] Connection header received
0806 15:11:55.154797 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:55.154803 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:55.154848 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:55.154957 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:55.155198 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:55.156145 (+ 947us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:55.157262 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:55.157755 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:55.157844 (+ 89us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:55.158620 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:55.158623 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:55.158624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:55.158788 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:55.158817 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:55.158828 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:55.158897 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:55.159020 (+ 123us) server_negotiation.cc:299] Negotiation successful
0806 15:11:55.159064 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":78,"threads_started":1}
I20260806 15:11:55.159747 19440 raft_consensus.cc:348] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32941 } }
I20260806 15:11:55.159917 19440 raft_consensus.cc:374] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:55.160014 19440 raft_consensus.cc:729] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a7ea099afc4b49cc81b6b2d8ddc921a0, State: Initialized, Role: FOLLOWER
I20260806 15:11:55.160162 19440 consensus_queue.cc:260] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32941 } }
I20260806 15:11:55.160274 19440 raft_consensus.cc:388] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:55.160283 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:55.160317 19440 raft_consensus.cc:482] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:55.160367 19440 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:55.160897 19440 raft_consensus.cc:504] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32941 } }
I20260806 15:11:55.161018 19440 leader_election.cc:302] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a7ea099afc4b49cc81b6b2d8ddc921a0; no voters:
I20260806 15:11:55.161213 19440 leader_election.cc:288] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:55.161245 19445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:55.161464 19445 raft_consensus.cc:686] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [term 1 LEADER]: Becoming Leader. State: Replica: a7ea099afc4b49cc81b6b2d8ddc921a0, State: Running, Role: LEADER
I20260806 15:11:55.161537 19440 sys_catalog.cc:564] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:55.161597 19445 consensus_queue.cc:237] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32941 } }
I20260806 15:11:55.161945 19445 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a7ea099afc4b49cc81b6b2d8ddc921a0. Latest consensus state: current_term: 1 leader_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32941 } } }
I20260806 15:11:55.162109 19445 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:55.161959 19450 sys_catalog.cc:455] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a7ea099afc4b49cc81b6b2d8ddc921a0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32941 } } }
I20260806 15:11:55.162358 19450 sys_catalog.cc:458] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:55.162372 19457 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:55.162997 19457 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:55.165468 19457 catalog_manager.cc:1347] Generated new cluster ID: f38725199ae146a7a4c18449385eda84
I20260806 15:11:55.165529 19457 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:55.165694 19443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:55.161867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:59073 (local address 127.0.0.1:32941)
0806 15:11:55.161909 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:55.161911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:55.161921 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:11:55.162014 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:55.162015 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:55.162026 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:55.162055 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:55.162276 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:55.163008 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:55.164240 (+ 1232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:55.164485 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:55.164592 (+ 107us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:55.165414 (+ 822us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:55.165416 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:55.165416 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:55.165421 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:55.165436 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:55.165440 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:55.165492 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:55.165619 (+ 127us) server_negotiation.cc:299] Negotiation successful
0806 15:11:55.165630 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:11:55.176532 19457 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:55.177230 19457 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:55.181483 19457 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a7ea099afc4b49cc81b6b2d8ddc921a0: Generated new TSK 0
I20260806 15:11:55.181653 19457 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:55.184813 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19369
W20260806 15:11:55.190097 19354 connection.cc:535] client connection to 127.0.0.1:32941 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32941): Connection reset by peer (error 104)
2026-08-06T15:11:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1314 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:55 dist-test-slave-tm1g krb5kdc[19471](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:55 dist-test-slave-tm1g krb5kdc[19471](info): set up 2 sockets
Aug 06 15:11:55 dist-test-slave-tm1g krb5kdc[19471](info): commencing operation
krb5kdc: starting...
W20260806 15:11:56.223177 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:56 dist-test-slave-tm1g krb5kdc[19471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260806 15:11:56.339262 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40119
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44835
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40119
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:56.420185 19485 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:56.420382 19485 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:56.420403 19485 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:56.421541 19485 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:56.421581 19485 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:56.421595 19485 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:56.421608 19485 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:56.421645 19485 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:56.423125 19485 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44835
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40119
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40119
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19485
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:56.423375 19485 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:56.423620 19485 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:56.428527 19491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:56.428535 19494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:56.428535 19492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:56.428566 19485 server_base.cc:1034] running on GCE node
I20260806 15:11:56.428964 19485 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:56.429224 19485 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:56.430377 19485 hybrid_clock.cc:648] HybridClock initialized: now 1786029116430350 us; error 34 us; skew 500 ppm
Aug 06 15:11:56 dist-test-slave-tm1g krb5kdc[19471](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029116, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:56.432775 19485 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260806 15:11:56.433257 19485 webserver.cc:460] Webserver started at http://127.0.0.1:39397/ using document root <none> and password file <none>
I20260806 15:11:56.433547 19485 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:56.433614 19485 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:56.433750 19485 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:56.434867 19485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "5755ccd216004bed9efca4159a82b82c"
format_stamp: "Formatted at 2026-08-06 15:11:56 on dist-test-slave-tm1g"
server_key: "90b401ea38041085f7b66009acd039ef"
server_key_iv: "0f1677d90dc491d53c2e9126f06bbcfe"
server_key_version: "encryptionkey@0"
I20260806 15:11:56.435233 19485 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "5755ccd216004bed9efca4159a82b82c"
format_stamp: "Formatted at 2026-08-06 15:11:56 on dist-test-slave-tm1g"
server_key: "90b401ea38041085f7b66009acd039ef"
server_key_iv: "0f1677d90dc491d53c2e9126f06bbcfe"
server_key_version: "encryptionkey@0"
I20260806 15:11:56.436549 19485 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:11:56.437288 19501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:56.437486 19485 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:56.437590 19485 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "5755ccd216004bed9efca4159a82b82c"
format_stamp: "Formatted at 2026-08-06 15:11:56 on dist-test-slave-tm1g"
server_key: "90b401ea38041085f7b66009acd039ef"
server_key_iv: "0f1677d90dc491d53c2e9126f06bbcfe"
server_key_version: "encryptionkey@0"
I20260806 15:11:56.437672 19485 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:56.440996 19485 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:56.442833 19485 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:56.442987 19485 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:56.447065 19485 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40119
I20260806 15:11:56.447098 19554 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40119 every 8 connection(s)
I20260806 15:11:56.447412 19485 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:56.448364 19555 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:56.450839 19555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c: Bootstrap starting.
I20260806 15:11:56.451612 19555 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:56.451932 19555 log.cc:824] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:56.452802 19555 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c: No bootstrap required, opened a new log
I20260806 15:11:56.453812 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19485
I20260806 15:11:56.453944 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:56.454121 29974 external_mini_cluster.cc:1428] Setting key ba9e2bc0122e3aafdd9c4a2386fa13c5
I20260806 15:11:56.455328 19555 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5755ccd216004bed9efca4159a82b82c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 15:11:56.455509 19555 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:56.455561 19555 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5755ccd216004bed9efca4159a82b82c, State: Initialized, Role: FOLLOWER
I20260806 15:11:56.455693 19555 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5755ccd216004bed9efca4159a82b82c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 15:11:56.455786 19555 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:56.455811 19555 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:56.455838 19555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:56.456316 19555 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5755ccd216004bed9efca4159a82b82c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 15:11:56.456401 19555 leader_election.cc:302] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5755ccd216004bed9efca4159a82b82c; no voters:
I20260806 15:11:56.456550 19555 leader_election.cc:288] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:56.456576 19561 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:56.456689 19561 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [term 1 LEADER]: Becoming Leader. State: Replica: 5755ccd216004bed9efca4159a82b82c, State: Running, Role: LEADER
I20260806 15:11:56.456769 19561 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5755ccd216004bed9efca4159a82b82c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } }
I20260806 15:11:56.456805 19555 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:56.457146 19563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5755ccd216004bed9efca4159a82b82c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5755ccd216004bed9efca4159a82b82c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } } }
I20260806 15:11:56.457252 19563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:56.457151 19564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5755ccd216004bed9efca4159a82b82c. Latest consensus state: current_term: 1 leader_uuid: "5755ccd216004bed9efca4159a82b82c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5755ccd216004bed9efca4159a82b82c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40119 } } }
I20260806 15:11:56.457398 19564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:56.457549 19566 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:56.457871 19560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:56.454735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:33969 (local address 127.0.0.1:40119)
0806 15:11:56.454932 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:56.454947 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:56.454973 (+ 26us) server_negotiation.cc:407] Connection header received
0806 15:11:56.455314 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:56.455319 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:56.455342 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:56.455454 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:56.457342 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:56.457346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:56.457347 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:56.457352 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:56.457396 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:56.457410 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:56.457449 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:56.457583 (+ 134us) server_negotiation.cc:299] Negotiation successful
0806 15:11:56.457631 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":91,"threads_started":1}
I20260806 15:11:56.458465 19566 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:56.458941 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:56.460155 19566 catalog_manager.cc:1347] Generated new cluster ID: 663287e277104cb5a05477bdb551739a
I20260806 15:11:56.460204 19566 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:56.463698 19560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:56.462635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.78:55655 (local address 127.0.0.1:40119)
0806 15:11:56.462670 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:56.462672 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:56.462805 (+ 133us) server_negotiation.cc:407] Connection header received
0806 15:11:56.462853 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:56.462853 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:56.462859 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:56.462911 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:56.463476 (+ 565us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:56.463477 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:56.463478 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:56.463481 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:56.463496 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:56.463500 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:56.463551 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:56.463631 (+ 80us) server_negotiation.cc:299] Negotiation successful
0806 15:11:56.463643 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:11:56.469954 19566 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:56.470103 19566 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:56.474882 19566 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5755ccd216004bed9efca4159a82b82c: Generated new TSK 0
I20260806 15:11:56.475051 19566 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:56.478787 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19485
2026-08-06T15:11:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:56 dist-test-slave-tm1g krb5kdc[19589](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:56 dist-test-slave-tm1g krb5kdc[19589](info): set up 2 sockets
Aug 06 15:11:56 dist-test-slave-tm1g krb5kdc[19589](info): commencing operation
krb5kdc: starting...
W20260806 15:11:57.531333 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.034s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:57 dist-test-slave-tm1g krb5kdc[19589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:11:57.649494 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:41401
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:43095
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:41401
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:57.730409 19602 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:57.730649 19602 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:57.730688 19602 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:57.731843 19602 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:57.731920 19602 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:57.731947 19602 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:57.731977 19602 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:57.732013 19602 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:57.733518 19602 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:43095
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:41401
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:41401
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19602
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:57.733789 19602 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:57.734026 19602 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:57.738903 19607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:57.738979 19602 server_base.cc:1034] running on GCE node
W20260806 15:11:57.738929 19608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:57.738940 19610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:57.739344 19602 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:57.739678 19602 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:57.740856 19602 hybrid_clock.cc:648] HybridClock initialized: now 1786029117740812 us; error 51 us; skew 500 ppm
Aug 06 15:11:57 dist-test-slave-tm1g krb5kdc[19589](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029117, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:57.748168 19602 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:11:57.748631 19602 webserver.cc:460] Webserver started at http://127.29.69.190:34677/ using document root <none> and password file <none>
I20260806 15:11:57.748844 19602 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:57.748885 19602 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:57.748986 19602 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:57.750028 19602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "75dfe84fa7b148eeacec035780560456"
format_stamp: "Formatted at 2026-08-06 15:11:57 on dist-test-slave-tm1g"
server_key: "a1c7b9d7c825877cd9b24387d4a06897"
server_key_iv: "a82738423fa2e636442ae93193583f25"
server_key_version: "encryptionkey@0"
I20260806 15:11:57.750393 19602 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "75dfe84fa7b148eeacec035780560456"
format_stamp: "Formatted at 2026-08-06 15:11:57 on dist-test-slave-tm1g"
server_key: "a1c7b9d7c825877cd9b24387d4a06897"
server_key_iv: "a82738423fa2e636442ae93193583f25"
server_key_version: "encryptionkey@0"
I20260806 15:11:57.751720 19602 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:57.752458 19617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:57.752665 19602 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:57.752763 19602 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "75dfe84fa7b148eeacec035780560456"
format_stamp: "Formatted at 2026-08-06 15:11:57 on dist-test-slave-tm1g"
server_key: "a1c7b9d7c825877cd9b24387d4a06897"
server_key_iv: "a82738423fa2e636442ae93193583f25"
server_key_version: "encryptionkey@0"
I20260806 15:11:57.752842 19602 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:57.771090 19602 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:57.773444 19602 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:57.773597 19602 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:57.777587 19602 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:41401
I20260806 15:11:57.777640 19670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:41401 every 8 connection(s)
I20260806 15:11:57.778007 19602 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:57.778999 19671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:57.781313 19671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456: Bootstrap starting.
I20260806 15:11:57.781919 19671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:57.782212 19671 log.cc:824] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:57.783049 19671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456: No bootstrap required, opened a new log
I20260806 15:11:57.784246 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19602
I20260806 15:11:57.784379 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:57.784577 29974 external_mini_cluster.cc:1428] Setting key 8bed93fde20fad56f39869adfe8a42bd
I20260806 15:11:57.785116 19671 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75dfe84fa7b148eeacec035780560456" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41401 } }
I20260806 15:11:57.785303 19671 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:57.785378 19671 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75dfe84fa7b148eeacec035780560456, State: Initialized, Role: FOLLOWER
I20260806 15:11:57.785514 19671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75dfe84fa7b148eeacec035780560456" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41401 } }
I20260806 15:11:57.785578 19671 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:57.785616 19671 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:57.785669 19671 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:57.786624 19671 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75dfe84fa7b148eeacec035780560456" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41401 } }
I20260806 15:11:57.786746 19671 leader_election.cc:302] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75dfe84fa7b148eeacec035780560456; no voters:
I20260806 15:11:57.786947 19671 leader_election.cc:288] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:57.786969 19676 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:57.787081 19676 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [term 1 LEADER]: Becoming Leader. State: Replica: 75dfe84fa7b148eeacec035780560456, State: Running, Role: LEADER
I20260806 15:11:57.787164 19676 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75dfe84fa7b148eeacec035780560456" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41401 } }
I20260806 15:11:57.787222 19671 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:57.787495 19677 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75dfe84fa7b148eeacec035780560456. Latest consensus state: current_term: 1 leader_uuid: "75dfe84fa7b148eeacec035780560456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75dfe84fa7b148eeacec035780560456" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41401 } } }
I20260806 15:11:57.787724 19677 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:57.787648 19678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75dfe84fa7b148eeacec035780560456" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75dfe84fa7b148eeacec035780560456" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 41401 } } }
I20260806 15:11:57.787997 19678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456 [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:57.788256 19685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:57.788789 19685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:57.790339 19685 catalog_manager.cc:1347] Generated new cluster ID: 9c3ea15569334c56a5c1a2514d2efc96
I20260806 15:11:57.790390 19685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 06 15:11:57 dist-test-slave-tm1g krb5kdc[19589](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029117, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:11:57.795208 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:57.785119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49533 (local address 127.29.69.190:41401)
0806 15:11:57.785316 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:57.785326 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:57.785371 (+ 45us) server_negotiation.cc:407] Connection header received
0806 15:11:57.785489 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:57.785497 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:57.785550 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:57.785688 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:57.786373 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:57.787605 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:57.788742 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:57.789346 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:57.789474 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:57.791979 (+ 2505us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:57.791983 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:57.791983 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:57.791995 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:57.793635 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:57.794030 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:57.794033 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:57.794034 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:57.794129 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:57.794386 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:57.794387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:57.794387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:57.794627 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:57.794802 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:57.794908 (+ 106us) server_negotiation.cc:299] Negotiation successful
0806 15:11:57.795018 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":95,"threads_started":1}
I20260806 15:11:57.796208 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:57.804378 19675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:57.797516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48593 (local address 127.29.69.190:41401)
0806 15:11:57.797554 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:57.797557 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:57.798511 (+ 954us) server_negotiation.cc:407] Connection header received
0806 15:11:57.798586 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:57.798587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:57.798597 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:57.798639 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:57.799172 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:57.799664 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:57.800387 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:57.800599 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:57.800668 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:57.801835 (+ 1167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:57.801837 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:57.801837 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:11:57.801844 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:57.803229 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:57.803586 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:57.803587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:57.803588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:57.803643 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:11:57.803854 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:11:57.803855 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:11:57.803855 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:11:57.803972 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:57.804079 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:57.804204 (+ 125us) server_negotiation.cc:299] Negotiation successful
0806 15:11:57.804265 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:11:57.821859 19685 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:57.822496 19685 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:57.824821 19685 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75dfe84fa7b148eeacec035780560456: Generated new TSK 0
I20260806 15:11:57.825022 19685 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:57.828125 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19602
W20260806 15:11:57.833249 19587 connection.cc:535] client connection to 127.29.69.190:41401 recv error: Network error: failed to read from TLS socket (remote: 127.29.69.190:41401): Connection reset by peer (error 104)
2026-08-06T15:11:57Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:57 dist-test-slave-tm1g krb5kdc[19703](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:57 dist-test-slave-tm1g krb5kdc[19703](info): set up 2 sockets
Aug 06 15:11:57 dist-test-slave-tm1g krb5kdc[19703](info): commencing operation
krb5kdc: starting...
W20260806 15:11:58.874631 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:11:58 dist-test-slave-tm1g krb5kdc[19703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:11:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:11:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:11:58.992589 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36653
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:39949
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:36653
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:11:59.073346 19716 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:11:59.073549 19716 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:11:59.073573 19716 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:11:59.074753 19716 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:11:59.074797 19716 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:11:59.074811 19716 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:11:59.074824 19716 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:11:59.074836 19716 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:11:59.076315 19716 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:39949
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:36653
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:36653
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19716
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:11:59.076613 19716 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:11:59.076840 19716 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:11:59.081776 19722 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:59.081784 19721 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:11:59.081776 19725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:11:59.081821 19716 server_base.cc:1034] running on GCE node
I20260806 15:11:59.082237 19716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:11:59.082587 19716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:11:59.083729 19716 hybrid_clock.cc:648] HybridClock initialized: now 1786029119083717 us; error 30 us; skew 500 ppm
Aug 06 15:11:59 dist-test-slave-tm1g krb5kdc[19703](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029119, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:11:59.086227 19716 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:11:59.086702 19716 webserver.cc:460] Webserver started at http://127.29.69.190:42107/ using document root <none> and password file <none>
I20260806 15:11:59.086905 19716 fs_manager.cc:359] Metadata directory not provided
I20260806 15:11:59.086946 19716 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:11:59.087038 19716 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:11:59.088039 19716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "a9935da602214d4497765a5ff26542dd"
format_stamp: "Formatted at 2026-08-06 15:11:59 on dist-test-slave-tm1g"
server_key: "f3044cda3c5a81f6b77814061ced302f"
server_key_iv: "502edc246f72bef390d9ae6eacd80dfb"
server_key_version: "encryptionkey@0"
I20260806 15:11:59.088338 19716 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "a9935da602214d4497765a5ff26542dd"
format_stamp: "Formatted at 2026-08-06 15:11:59 on dist-test-slave-tm1g"
server_key: "f3044cda3c5a81f6b77814061ced302f"
server_key_iv: "502edc246f72bef390d9ae6eacd80dfb"
server_key_version: "encryptionkey@0"
I20260806 15:11:59.089640 19716 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260806 15:11:59.090371 19732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:11:59.090592 19716 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:11:59.090700 19716 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "a9935da602214d4497765a5ff26542dd"
format_stamp: "Formatted at 2026-08-06 15:11:59 on dist-test-slave-tm1g"
server_key: "f3044cda3c5a81f6b77814061ced302f"
server_key_iv: "502edc246f72bef390d9ae6eacd80dfb"
server_key_version: "encryptionkey@0"
I20260806 15:11:59.090781 19716 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:11:59.106500 19716 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:11:59.108762 19716 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:11:59.108932 19716 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:11:59.113013 19716 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:36653
I20260806 15:11:59.113059 19785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:36653 every 8 connection(s)
I20260806 15:11:59.113418 19716 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:11:59.114272 19786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:11:59.116632 19786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd: Bootstrap starting.
I20260806 15:11:59.117216 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19716
I20260806 15:11:59.117240 19786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd: Neither blocks nor log segments found. Creating new log.
I20260806 15:11:59.117357 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:11:59.117542 29974 external_mini_cluster.cc:1428] Setting key d92e66f01670abdc9d523e2c36c71a05
I20260806 15:11:59.117561 19786 log.cc:824] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd: Log is configured to *not* fsync() on all Append() calls
I20260806 15:11:59.118407 19786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd: No bootstrap required, opened a new log
I20260806 15:11:59.121119 19786 raft_consensus.cc:348] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9935da602214d4497765a5ff26542dd" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36653 } }
I20260806 15:11:59.121271 19786 raft_consensus.cc:374] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:11:59.121320 19786 raft_consensus.cc:729] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9935da602214d4497765a5ff26542dd, State: Initialized, Role: FOLLOWER
I20260806 15:11:59.121450 19786 consensus_queue.cc:260] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9935da602214d4497765a5ff26542dd" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36653 } }
I20260806 15:11:59.121542 19786 raft_consensus.cc:388] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:11:59.121587 19786 raft_consensus.cc:482] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:11:59.121634 19786 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:11:59.122383 19786 raft_consensus.cc:504] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9935da602214d4497765a5ff26542dd" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36653 } }
I20260806 15:11:59.122499 19786 leader_election.cc:302] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a9935da602214d4497765a5ff26542dd; no voters:
I20260806 15:11:59.122658 19786 leader_election.cc:288] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:11:59.122710 19791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:11:59.122869 19791 raft_consensus.cc:686] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [term 1 LEADER]: Becoming Leader. State: Replica: a9935da602214d4497765a5ff26542dd, State: Running, Role: LEADER
I20260806 15:11:59.122920 19786 sys_catalog.cc:564] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:11:59.122996 19791 consensus_queue.cc:237] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9935da602214d4497765a5ff26542dd" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36653 } }
I20260806 15:11:59.123752 19792 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a9935da602214d4497765a5ff26542dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9935da602214d4497765a5ff26542dd" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36653 } } }
I20260806 15:11:59.123836 19792 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:59.124094 19793 sys_catalog.cc:455] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [sys.catalog]: SysCatalogTable state changed. Reason: New leader a9935da602214d4497765a5ff26542dd. Latest consensus state: current_term: 1 leader_uuid: "a9935da602214d4497765a5ff26542dd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a9935da602214d4497765a5ff26542dd" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 36653 } } }
I20260806 15:11:59.124372 19793 sys_catalog.cc:458] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd [sys.catalog]: This master's current role is: LEADER
I20260806 15:11:59.124513 19800 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:11:59.124549 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:59.118030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37621 (local address 127.29.69.190:36653)
0806 15:11:59.118222 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:59.118231 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:59.118262 (+ 31us) server_negotiation.cc:407] Connection header received
0806 15:11:59.118830 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:59.118838 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:59.118917 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:59.119066 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:59.119339 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:59.120846 (+ 1507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:59.121794 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:59.122448 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:59.122560 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:59.123492 (+ 932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:59.123497 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:59.123497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:59.123704 (+ 207us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:59.123741 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:59.123756 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:59.123839 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:59.124130 (+ 291us) server_negotiation.cc:299] Negotiation successful
0806 15:11:59.124166 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":92,"threads_started":1}
I20260806 15:11:59.125025 19800 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:11:59.125730 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:11:59.126533 19800 catalog_manager.cc:1347] Generated new cluster ID: a5b204b875ef4325b3a1d903dd42031e
I20260806 15:11:59.126586 19800 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:11:59.134893 19800 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:11:59.135473 19800 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:11:59.138211 19790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:11:59.127312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51199 (local address 127.29.69.190:36653)
0806 15:11:59.127348 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:11:59.127349 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:11:59.134806 (+ 7457us) server_negotiation.cc:407] Connection header received
0806 15:11:59.134871 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:11:59.134872 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:11:59.134883 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:11:59.134943 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:11:59.135112 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:59.135836 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:59.136854 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:11:59.137181 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:11:59.137252 (+ 71us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:11:59.137959 (+ 707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:11:59.137961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:11:59.137961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:11:59.137965 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:11:59.137982 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:11:59.137986 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:11:59.138048 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:11:59.138126 (+ 78us) server_negotiation.cc:299] Negotiation successful
0806 15:11:59.138136 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:11:59.139698 19800 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a9935da602214d4497765a5ff26542dd: Generated new TSK 0
I20260806 15:11:59.139866 19800 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:11:59.145651 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19716
W20260806 15:11:59.151047 19701 connection.cc:535] client connection to 127.29.69.190:36653 recv error: Network error: failed to read from TLS socket (remote: 127.29.69.190:36653): Connection reset by peer (error 104)
2026-08-06T15:11:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:11:59 dist-test-slave-tm1g krb5kdc[19819](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:11:59 dist-test-slave-tm1g krb5kdc[19819](info): set up 2 sockets
Aug 06 15:11:59 dist-test-slave-tm1g krb5kdc[19819](info): commencing operation
krb5kdc: starting...
W20260806 15:12:00.210739 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.046s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:12:00 dist-test-slave-tm1g krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029120, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:12:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:12:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:12:00.329445 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33577
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:36785
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:33577
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:12:00.413764 19833 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:00.414014 19833 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:00.414054 19833 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:00.415335 19833 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:00.415405 19833 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:00.415433 19833 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:00.415474 19833 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:00.415508 19833 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:00.416980 19833 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:36785
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:33577
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19833
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:00.417248 19833 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:00.417474 19833 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:00.422434 19841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:00.422391 19839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:00.422674 19833 server_base.cc:1034] running on GCE node
W20260806 15:12:00.422456 19838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:00.423020 19833 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:00.423678 19833 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:00.424924 19833 hybrid_clock.cc:648] HybridClock initialized: now 1786029120424875 us; error 70 us; skew 500 ppm
Aug 06 15:12:00 dist-test-slave-tm1g krb5kdc[19819](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029120, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:00.428668 19833 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:12:00.429240 19833 webserver.cc:460] Webserver started at http://127.29.69.190:42487/ using document root <none> and password file <none>
I20260806 15:12:00.429483 19833 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:00.429559 19833 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:00.429714 19833 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:00.430945 19833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "4d76b68985234c96ab066d4b17c7956f"
format_stamp: "Formatted at 2026-08-06 15:12:00 on dist-test-slave-tm1g"
server_key: "faed5d4a9dea58d415597670f7d73c36"
server_key_iv: "473e8dad53487c3d4c03df6c1ca37438"
server_key_version: "encryptionkey@0"
I20260806 15:12:00.431332 19833 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "4d76b68985234c96ab066d4b17c7956f"
format_stamp: "Formatted at 2026-08-06 15:12:00 on dist-test-slave-tm1g"
server_key: "faed5d4a9dea58d415597670f7d73c36"
server_key_iv: "473e8dad53487c3d4c03df6c1ca37438"
server_key_version: "encryptionkey@0"
I20260806 15:12:00.432940 19833 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:12:00.434114 19848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:00.434376 19833 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:00.434494 19833 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "4d76b68985234c96ab066d4b17c7956f"
format_stamp: "Formatted at 2026-08-06 15:12:00 on dist-test-slave-tm1g"
server_key: "faed5d4a9dea58d415597670f7d73c36"
server_key_iv: "473e8dad53487c3d4c03df6c1ca37438"
server_key_version: "encryptionkey@0"
I20260806 15:12:00.434594 19833 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:00.438058 19833 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:00.441131 19833 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:00.441315 19833 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:00.446038 19833 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:33577
I20260806 15:12:00.446072 19902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:33577 every 8 connection(s)
I20260806 15:12:00.446511 19833 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:12:00.447577 19903 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:00.449892 19903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f: Bootstrap starting.
I20260806 15:12:00.450481 19903 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:00.450747 19903 log.cc:824] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:00.451445 19903 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f: No bootstrap required, opened a new log
I20260806 15:12:00.452998 19903 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d76b68985234c96ab066d4b17c7956f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33577 } }
I20260806 15:12:00.453137 19903 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:12:00.453161 19903 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d76b68985234c96ab066d4b17c7956f, State: Initialized, Role: FOLLOWER
I20260806 15:12:00.453269 19903 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d76b68985234c96ab066d4b17c7956f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33577 } }
I20260806 15:12:00.453390 19903 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:12:00.453428 19903 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:12:00.453482 19903 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:00.454396 19903 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d76b68985234c96ab066d4b17c7956f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33577 } }
I20260806 15:12:00.454520 19903 leader_election.cc:302] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d76b68985234c96ab066d4b17c7956f; no voters:
I20260806 15:12:00.454684 19903 leader_election.cc:288] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:12:00.454725 19906 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:12:00.454927 19906 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [term 1 LEADER]: Becoming Leader. State: Replica: 4d76b68985234c96ab066d4b17c7956f, State: Running, Role: LEADER
I20260806 15:12:00.454945 19903 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:00.455024 19906 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d76b68985234c96ab066d4b17c7956f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33577 } }
I20260806 15:12:00.455566 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19833
I20260806 15:12:00.455684 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:12:00.455865 29974 external_mini_cluster.cc:1428] Setting key d0c77760b7c072fe3f735c5addfd161c
I20260806 15:12:00.456283 19907 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d76b68985234c96ab066d4b17c7956f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d76b68985234c96ab066d4b17c7956f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33577 } } }
I20260806 15:12:00.456573 19908 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d76b68985234c96ab066d4b17c7956f. Latest consensus state: current_term: 1 leader_uuid: "4d76b68985234c96ab066d4b17c7956f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d76b68985234c96ab066d4b17c7956f" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33577 } } }
I20260806 15:12:00.456672 19908 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:00.456380 19907 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f [sys.catalog]: This master's current role is: LEADER
W20260806 15:12:00.457026 19921 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:00.457108 19921 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:00.457171 19924 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:12:00.457360 19924 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:12:00.458434 19923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:00.456634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42293 (local address 127.29.69.190:33577)
0806 15:12:00.456832 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:00.456842 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:00.456899 (+ 57us) server_negotiation.cc:407] Connection header received
0806 15:12:00.457070 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:00.457078 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:00.457110 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:00.457248 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:00.457922 (+ 674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:00.457926 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:00.457926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:12:00.457930 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:00.457990 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:12:00.458006 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:00.458073 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:00.458187 (+ 114us) server_negotiation.cc:299] Negotiation successful
0806 15:12:00.458226 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":74,"threads_started":1}
I20260806 15:12:00.458925 19924 catalog_manager.cc:1347] Generated new cluster ID: 8a4e747b699d411dba62ed0ab4d7d882
I20260806 15:12:00.459014 19924 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:12:00.459475 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:12:00.461990 19923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:00.460856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32775 (local address 127.29.69.190:33577)
0806 15:12:00.460889 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:00.460892 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:00.461079 (+ 187us) server_negotiation.cc:407] Connection header received
0806 15:12:00.461148 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:00.461149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:00.461154 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:00.461209 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:00.461772 (+ 563us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:00.461773 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:00.461773 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:12:00.461778 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:00.461792 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:12:00.461796 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:00.461841 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:00.461903 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 15:12:00.461917 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260806 15:12:00.468592 19924 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:12:00.468747 19924 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:12:00.477480 19924 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d76b68985234c96ab066d4b17c7956f: Generated new TSK 0
I20260806 15:12:00.477662 19924 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:12:00.481580 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19833
2026-08-06T15:12:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1335 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:12:00 dist-test-slave-tm1g krb5kdc[19935](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:12:00 dist-test-slave-tm1g krb5kdc[19935](info): set up 2 sockets
Aug 06 15:12:00 dist-test-slave-tm1g krb5kdc[19935](info): commencing operation
krb5kdc: starting...
W20260806 15:12:01.527456 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:12:01 dist-test-slave-tm1g krb5kdc[19935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:12:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:12:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:12:01.643079 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33655
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:41911
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:33655
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:12:01.723825 19948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:01.724033 19948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:01.724057 19948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:01.725219 19948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:01.725261 19948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:01.725276 19948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:01.725288 19948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:01.725301 19948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:01.726965 19948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:41911
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:33655
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33655
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:01.727228 19948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:01.727447 19948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:01.732213 19954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:01.732208 19956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:01.732204 19953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:01.732451 19948 server_base.cc:1034] running on GCE node
I20260806 15:12:01.732796 19948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:01.733079 19948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:01.734217 19948 hybrid_clock.cc:648] HybridClock initialized: now 1786029121734206 us; error 27 us; skew 500 ppm
Aug 06 15:12:01 dist-test-slave-tm1g krb5kdc[19935](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029121, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:01.736531 19948 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:12:01.736976 19948 webserver.cc:460] Webserver started at http://127.29.69.190:34653/ using document root <none> and password file <none>
I20260806 15:12:01.737200 19948 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:01.737265 19948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:01.737411 19948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:01.738524 19948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "caf10971ab644530831f54c88ce5df48"
format_stamp: "Formatted at 2026-08-06 15:12:01 on dist-test-slave-tm1g"
server_key: "efe82f84517ea5b58f0525a17cca55da"
server_key_iv: "f7e6de5c57f83cf37bcd87263b365cba"
server_key_version: "encryptionkey@0"
I20260806 15:12:01.738888 19948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "caf10971ab644530831f54c88ce5df48"
format_stamp: "Formatted at 2026-08-06 15:12:01 on dist-test-slave-tm1g"
server_key: "efe82f84517ea5b58f0525a17cca55da"
server_key_iv: "f7e6de5c57f83cf37bcd87263b365cba"
server_key_version: "encryptionkey@0"
I20260806 15:12:01.740365 19948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:01.741407 19964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:01.741618 19948 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:01.741722 19948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "caf10971ab644530831f54c88ce5df48"
format_stamp: "Formatted at 2026-08-06 15:12:01 on dist-test-slave-tm1g"
server_key: "efe82f84517ea5b58f0525a17cca55da"
server_key_iv: "f7e6de5c57f83cf37bcd87263b365cba"
server_key_version: "encryptionkey@0"
I20260806 15:12:01.741811 19948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:01.770648 19948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:01.772578 19948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:01.772693 19948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:01.776809 19948 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:33655
I20260806 15:12:01.776849 20017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:33655 every 8 connection(s)
I20260806 15:12:01.777217 19948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:12:01.777490 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 19948
I20260806 15:12:01.777644 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:12:01.777873 29974 external_mini_cluster.cc:1428] Setting key c5c205ae7b548f9fa52f0f8b56e07ff0
I20260806 15:12:01.778295 20018 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:01.781514 20018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48: Bootstrap starting.
I20260806 15:12:01.782198 20018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:01.782523 20018 log.cc:824] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:01.783216 20018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48: No bootstrap required, opened a new log
Aug 06 15:12:01 dist-test-slave-tm1g krb5kdc[19935](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029121, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:01.785531 20018 raft_consensus.cc:348] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf10971ab644530831f54c88ce5df48" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33655 } }
I20260806 15:12:01.785666 20018 raft_consensus.cc:374] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:12:01.785709 20018 raft_consensus.cc:729] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: caf10971ab644530831f54c88ce5df48, State: Initialized, Role: FOLLOWER
I20260806 15:12:01.785856 20018 consensus_queue.cc:260] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf10971ab644530831f54c88ce5df48" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33655 } }
I20260806 15:12:01.785917 20018 raft_consensus.cc:388] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:12:01.785962 20018 raft_consensus.cc:482] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:12:01.786013 20018 raft_consensus.cc:3037] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:01.786688 20018 raft_consensus.cc:504] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf10971ab644530831f54c88ce5df48" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33655 } }
I20260806 15:12:01.786777 20018 leader_election.cc:302] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: caf10971ab644530831f54c88ce5df48; no voters:
I20260806 15:12:01.786979 20018 leader_election.cc:288] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:12:01.787031 20023 raft_consensus.cc:2781] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:12:01.787186 20023 raft_consensus.cc:686] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [term 1 LEADER]: Becoming Leader. State: Replica: caf10971ab644530831f54c88ce5df48, State: Running, Role: LEADER
I20260806 15:12:01.787250 20018 sys_catalog.cc:564] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:01.787285 20023 consensus_queue.cc:237] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf10971ab644530831f54c88ce5df48" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33655 } }
I20260806 15:12:01.787648 20024 sys_catalog.cc:455] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [sys.catalog]: SysCatalogTable state changed. Reason: New leader caf10971ab644530831f54c88ce5df48. Latest consensus state: current_term: 1 leader_uuid: "caf10971ab644530831f54c88ce5df48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf10971ab644530831f54c88ce5df48" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33655 } } }
I20260806 15:12:01.787760 20024 sys_catalog.cc:458] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:01.787840 20025 sys_catalog.cc:455] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "caf10971ab644530831f54c88ce5df48" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "caf10971ab644530831f54c88ce5df48" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33655 } } }
I20260806 15:12:01.787947 20025 sys_catalog.cc:458] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:01.788081 20031 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:12:01.788617 20031 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:12:01.789237 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:01.778410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60849 (local address 127.29.69.190:33655)
0806 15:12:01.778595 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:01.778605 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:01.778635 (+ 30us) server_negotiation.cc:407] Connection header received
0806 15:12:01.779071 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:01.779077 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:01.779123 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:01.779232 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:01.780048 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:01.780919 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:01.781997 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:01.782467 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:01.782555 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:01.785262 (+ 2707us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:01.785266 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:01.785267 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:01.785276 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:01.787157 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:01.787557 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:01.787560 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:01.787560 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:01.787670 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:01.788207 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:01.788207 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:01.788208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:01.788568 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:01.788739 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:01.788861 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 15:12:01.789007 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":118,"threads_started":1}
I20260806 15:12:01.790202 20031 catalog_manager.cc:1347] Generated new cluster ID: 5f8531ed2154483cb93a006edf9a6309
I20260806 15:12:01.790262 20031 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:12:01.790448 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:12:01.793548 20031 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:12:01.794032 20031 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:12:01.799316 20021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:01.791922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57797 (local address 127.29.69.190:33655)
0806 15:12:01.791952 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:01.791954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:01.792057 (+ 103us) server_negotiation.cc:407] Connection header received
0806 15:12:01.792133 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:01.792134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:01.792143 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:01.792185 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:01.792822 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:01.793384 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:01.794482 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:01.795161 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:01.795227 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:01.796622 (+ 1395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:01.796623 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:01.796623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:01.796630 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:01.798142 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:01.798555 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:01.798556 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:01.798556 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:01.798610 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:01.798809 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:01.798809 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:01.798810 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:01.798918 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:01.799003 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:01.799147 (+ 144us) server_negotiation.cc:299] Negotiation successful
0806 15:12:01.799229 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260806 15:12:01.802767 20031 catalog_manager.cc:5868] T 00000000000000000000000000000000 P caf10971ab644530831f54c88ce5df48: Generated new TSK 0
I20260806 15:12:01.802932 20031 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:12:01.804600 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 19948
2026-08-06T15:12:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1323 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:12:01 dist-test-slave-tm1g krb5kdc[20049](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:12:01 dist-test-slave-tm1g krb5kdc[20049](info): set up 2 sockets
Aug 06 15:12:01 dist-test-slave-tm1g krb5kdc[20049](info): commencing operation
krb5kdc: starting...
W20260806 15:12:02.891286 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.068s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:12:02 dist-test-slave-tm1g krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029122, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:12:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:12:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:12:03.009173 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35717
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:45699
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:35717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:12:03.090206 20062 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:03.090477 20062 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:03.090504 20062 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:03.091670 20062 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:03.091711 20062 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:03.091725 20062 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:03.091760 20062 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:03.091786 20062 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:03.093258 20062 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:45699
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:35717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:35717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20062
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:03.093536 20062 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:03.093778 20062 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:03.098590 20068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:03.098625 20067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:03.098628 20070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:03.098827 20062 server_base.cc:1034] running on GCE node
I20260806 15:12:03.099071 20062 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:03.099308 20062 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:03.100445 20062 hybrid_clock.cc:648] HybridClock initialized: now 1786029123100429 us; error 39 us; skew 500 ppm
Aug 06 15:12:03 dist-test-slave-tm1g krb5kdc[20049](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029123, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:03.107955 20062 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:12:03.108393 20062 webserver.cc:460] Webserver started at http://127.29.69.190:41383/ using document root <none> and password file <none>
I20260806 15:12:03.108619 20062 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:03.108685 20062 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:03.108830 20062 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:03.109881 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "12779e59254e4fcca7dc0b2affbcfde2"
format_stamp: "Formatted at 2026-08-06 15:12:03 on dist-test-slave-tm1g"
server_key: "bfe64a798d307511933887622d9ee852"
server_key_iv: "c7618225825b2d0dd42779a9b733f573"
server_key_version: "encryptionkey@0"
I20260806 15:12:03.110237 20062 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "12779e59254e4fcca7dc0b2affbcfde2"
format_stamp: "Formatted at 2026-08-06 15:12:03 on dist-test-slave-tm1g"
server_key: "bfe64a798d307511933887622d9ee852"
server_key_iv: "c7618225825b2d0dd42779a9b733f573"
server_key_version: "encryptionkey@0"
I20260806 15:12:03.111613 20062 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:12:03.112402 20077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:03.112607 20062 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:12:03.112707 20062 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "12779e59254e4fcca7dc0b2affbcfde2"
format_stamp: "Formatted at 2026-08-06 15:12:03 on dist-test-slave-tm1g"
server_key: "bfe64a798d307511933887622d9ee852"
server_key_iv: "c7618225825b2d0dd42779a9b733f573"
server_key_version: "encryptionkey@0"
I20260806 15:12:03.112782 20062 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:03.134443 20062 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:03.136317 20062 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:03.136477 20062 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:03.140432 20062 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:35717
I20260806 15:12:03.140470 20130 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:35717 every 8 connection(s)
I20260806 15:12:03.140837 20062 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:12:03.141721 20131 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:03.144016 20131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2: Bootstrap starting.
I20260806 15:12:03.144166 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20062
I20260806 15:12:03.144290 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:12:03.144505 29974 external_mini_cluster.cc:1428] Setting key 95cc6053a71a5f3bb912ad4807b4c278
I20260806 15:12:03.144754 20131 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:03.145102 20131 log.cc:824] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:03.145772 20131 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2: No bootstrap required, opened a new log
I20260806 15:12:03.147630 20131 raft_consensus.cc:348] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12779e59254e4fcca7dc0b2affbcfde2" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35717 } }
I20260806 15:12:03.147779 20131 raft_consensus.cc:374] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:12:03.147853 20131 raft_consensus.cc:729] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12779e59254e4fcca7dc0b2affbcfde2, State: Initialized, Role: FOLLOWER
I20260806 15:12:03.147994 20131 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12779e59254e4fcca7dc0b2affbcfde2" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35717 } }
I20260806 15:12:03.148067 20131 raft_consensus.cc:388] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:12:03.148097 20131 raft_consensus.cc:482] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:12:03.148141 20131 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:03.148808 20131 raft_consensus.cc:504] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12779e59254e4fcca7dc0b2affbcfde2" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35717 } }
I20260806 15:12:03.148963 20131 leader_election.cc:302] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12779e59254e4fcca7dc0b2affbcfde2; no voters:
I20260806 15:12:03.149143 20131 leader_election.cc:288] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:12:03.149196 20136 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:12:03.149339 20136 raft_consensus.cc:686] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [term 1 LEADER]: Becoming Leader. State: Replica: 12779e59254e4fcca7dc0b2affbcfde2, State: Running, Role: LEADER
I20260806 15:12:03.149406 20131 sys_catalog.cc:564] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:03.149441 20136 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12779e59254e4fcca7dc0b2affbcfde2" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35717 } }
I20260806 15:12:03.149762 20136 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12779e59254e4fcca7dc0b2affbcfde2. Latest consensus state: current_term: 1 leader_uuid: "12779e59254e4fcca7dc0b2affbcfde2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12779e59254e4fcca7dc0b2affbcfde2" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35717 } } }
I20260806 15:12:03.149770 20137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12779e59254e4fcca7dc0b2affbcfde2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12779e59254e4fcca7dc0b2affbcfde2" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 35717 } } }
I20260806 15:12:03.149987 20137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:03.150060 20134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:03.145003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60081 (local address 127.29.69.190:35717)
0806 15:12:03.145221 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:03.145230 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:03.145263 (+ 33us) server_negotiation.cc:407] Connection header received
0806 15:12:03.145704 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:03.145710 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:03.145752 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:03.145894 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:03.146102 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:03.147041 (+ 939us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:03.147853 (+ 812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:03.148484 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:03.148607 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:03.149270 (+ 663us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:03.149274 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:03.149274 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:12:03.149487 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:03.149525 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:12:03.149539 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:03.149614 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:03.149731 (+ 117us) server_negotiation.cc:299] Negotiation successful
0806 15:12:03.149804 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":99,"threads_started":1}
I20260806 15:12:03.149904 20136 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:03.150389 20145 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:12:03.150871 20145 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:12:03.151021 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:12:03.152359 20145 catalog_manager.cc:1347] Generated new cluster ID: c33778c9e5b847f789ae9e4b79b5cf41
I20260806 15:12:03.152410 20145 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:12:03.155854 20134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:03.152573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43839 (local address 127.29.69.190:35717)
0806 15:12:03.152613 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:03.152614 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:03.152741 (+ 127us) server_negotiation.cc:407] Connection header received
0806 15:12:03.152770 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:03.152771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:03.152782 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:03.152850 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:03.152965 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:03.153655 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:03.154609 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:03.154913 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:03.154991 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:03.155622 (+ 631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:03.155623 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:03.155624 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:12:03.155628 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:03.155644 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:12:03.155649 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:03.155701 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:03.155763 (+ 62us) server_negotiation.cc:299] Negotiation successful
0806 15:12:03.155785 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260806 15:12:03.174485 20145 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:12:03.175252 20145 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:12:03.184064 20145 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 12779e59254e4fcca7dc0b2affbcfde2: Generated new TSK 0
I20260806 15:12:03.184263 20145 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:12:03.187816 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20062
2026-08-06T15:12:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1382 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:12:03 dist-test-slave-tm1g krb5kdc[20163](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:12:03 dist-test-slave-tm1g krb5kdc[20163](info): set up 2 sockets
Aug 06 15:12:03 dist-test-slave-tm1g krb5kdc[20163](info): commencing operation
krb5kdc: starting...
W20260806 15:12:04.226761 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:12:04 dist-test-slave-tm1g krb5kdc[20163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029124, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:12:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:12:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:12:04.343184 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:43537
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:46287
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:43537
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:12:04.423313 20176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:04.423560 20176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:04.423597 20176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:04.424758 20176 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:04.424822 20176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:04.424847 20176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:04.424876 20176 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:04.424901 20176 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:04.426482 20176 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:46287
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:43537
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:43537
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20176
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:04.426750 20176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:04.426972 20176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:04.431763 20182 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:04.431775 20181 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:04.431941 20176 server_base.cc:1034] running on GCE node
W20260806 15:12:04.431775 20184 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:04.432406 20176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:04.432700 20176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:04.433864 20176 hybrid_clock.cc:648] HybridClock initialized: now 1786029124433856 us; error 34 us; skew 500 ppm
Aug 06 15:12:04 dist-test-slave-tm1g krb5kdc[20163](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029124, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:04.436268 20176 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:12:04.436719 20176 webserver.cc:460] Webserver started at http://127.29.69.190:33379/ using document root <none> and password file <none>
I20260806 15:12:04.436985 20176 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:04.437054 20176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:04.437199 20176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:04.438247 20176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "e1a71b05401d402183983d43b245aacb"
format_stamp: "Formatted at 2026-08-06 15:12:04 on dist-test-slave-tm1g"
server_key: "ed49c8c17723134d56f3defc380bf9e0"
server_key_iv: "fa1add2d52866492fdbf6c171f3aaa1a"
server_key_version: "encryptionkey@0"
I20260806 15:12:04.438656 20176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "e1a71b05401d402183983d43b245aacb"
format_stamp: "Formatted at 2026-08-06 15:12:04 on dist-test-slave-tm1g"
server_key: "ed49c8c17723134d56f3defc380bf9e0"
server_key_iv: "fa1add2d52866492fdbf6c171f3aaa1a"
server_key_version: "encryptionkey@0"
I20260806 15:12:04.439988 20176 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:04.440666 20191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:04.440831 20176 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260806 15:12:04.440940 20176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "e1a71b05401d402183983d43b245aacb"
format_stamp: "Formatted at 2026-08-06 15:12:04 on dist-test-slave-tm1g"
server_key: "ed49c8c17723134d56f3defc380bf9e0"
server_key_iv: "fa1add2d52866492fdbf6c171f3aaa1a"
server_key_version: "encryptionkey@0"
I20260806 15:12:04.441013 20176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:04.444288 20176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:04.446081 20176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:04.446230 20176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:04.450042 20176 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:43537
I20260806 15:12:04.450088 20244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:43537 every 8 connection(s)
I20260806 15:12:04.450474 20176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:12:04.451458 20245 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:04.453598 20245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb: Bootstrap starting.
I20260806 15:12:04.454175 20245 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:04.454495 20245 log.cc:824] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:04.455133 20245 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb: No bootstrap required, opened a new log
I20260806 15:12:04.456657 20245 raft_consensus.cc:348] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a71b05401d402183983d43b245aacb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43537 } }
I20260806 15:12:04.456785 20245 raft_consensus.cc:374] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260806 15:12:04.456807 20245 raft_consensus.cc:729] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a71b05401d402183983d43b245aacb, State: Initialized, Role: FOLLOWER
I20260806 15:12:04.456936 20245 consensus_queue.cc:260] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a71b05401d402183983d43b245aacb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43537 } }
I20260806 15:12:04.457011 20245 raft_consensus.cc:388] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260806 15:12:04.457052 20245 raft_consensus.cc:482] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260806 15:12:04.457129 20245 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:04.457239 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20176
I20260806 15:12:04.457360 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:12:04.457548 29974 external_mini_cluster.cc:1428] Setting key c763e2eb5d0939677cd9f4d61221d3ca
I20260806 15:12:04.458295 20245 raft_consensus.cc:504] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a71b05401d402183983d43b245aacb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43537 } }
I20260806 15:12:04.458441 20245 leader_election.cc:302] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e1a71b05401d402183983d43b245aacb; no voters:
I20260806 15:12:04.458611 20245 leader_election.cc:288] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260806 15:12:04.458698 20250 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:12:04.458896 20250 raft_consensus.cc:686] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [term 1 LEADER]: Becoming Leader. State: Replica: e1a71b05401d402183983d43b245aacb, State: Running, Role: LEADER
I20260806 15:12:04.458995 20250 consensus_queue.cc:237] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a71b05401d402183983d43b245aacb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43537 } }
I20260806 15:12:04.459156 20245 sys_catalog.cc:564] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:04.459357 20252 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e1a71b05401d402183983d43b245aacb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a71b05401d402183983d43b245aacb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43537 } } }
I20260806 15:12:04.459484 20252 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:04.459353 20250 sys_catalog.cc:455] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [sys.catalog]: SysCatalogTable state changed. Reason: New leader e1a71b05401d402183983d43b245aacb. Latest consensus state: current_term: 1 leader_uuid: "e1a71b05401d402183983d43b245aacb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e1a71b05401d402183983d43b245aacb" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 43537 } } }
I20260806 15:12:04.459713 20250 sys_catalog.cc:458] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:04.459993 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:04.458018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55807 (local address 127.29.69.190:43537)
0806 15:12:04.458203 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:04.458211 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:04.458246 (+ 35us) server_negotiation.cc:407] Connection header received
0806 15:12:04.458455 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:04.458462 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:04.458494 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:04.458658 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:04.459346 (+ 688us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:04.459350 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:04.459350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:12:04.459354 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:04.459401 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:12:04.459417 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:04.459696 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:04.459730 (+ 34us) server_negotiation.cc:299] Negotiation successful
0806 15:12:04.459771 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":108,"threads_started":1}
I20260806 15:12:04.460901 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260806 15:12:04.461050 20266 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:04.461107 20266 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:04.462056 20255 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:12:04.462265 20255 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:12:04.463779 20249 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:04.462205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45721 (local address 127.29.69.190:43537)
0806 15:12:04.462245 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:04.462247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:04.462475 (+ 228us) server_negotiation.cc:407] Connection header received
0806 15:12:04.462551 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:04.462552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:04.462557 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:04.462621 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:04.463463 (+ 842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:04.463465 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:04.463465 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0806 15:12:04.463471 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:04.463487 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0806 15:12:04.463492 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:04.463550 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:04.463698 (+ 148us) server_negotiation.cc:299] Negotiation successful
0806 15:12:04.463714 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:12:04.464004 20255 catalog_manager.cc:1347] Generated new cluster ID: 671ce3d27b7b44199f969c22e58c8880
I20260806 15:12:04.464046 20255 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:12:04.468675 20255 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:12:04.468823 20255 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:12:04.472992 20255 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e1a71b05401d402183983d43b245aacb: Generated new TSK 0
I20260806 15:12:04.473146 20255 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260806 15:12:04.479123 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20176
2026-08-06T15:12:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1291 ms)
[----------] 18 tests from AuthTokenIssuingTest (24069 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:12:04 dist-test-slave-tm1g krb5kdc[20276](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:12:04 dist-test-slave-tm1g krb5kdc[20276](info): set up 2 sockets
Aug 06 15:12:04 dist-test-slave-tm1g krb5kdc[20276](info): commencing operation
krb5kdc: starting...
W20260806 15:12:05.527714 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:12:05 dist-test-slave-tm1g krb5kdc[20276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:12:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:12:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:12:05.641242 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33107
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:33107,127.29.69.189:34447,127.29.69.188:40695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:12:05.728260 20289 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:12:05.728466 20289 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:05.728482 20289 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:05.728503 20289 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:05.729573 20289 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:05.729614 20289 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:05.729628 20289 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:05.729640 20289 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:05.729652 20289 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:05.731156 20289 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:33107,127.29.69.189:34447,127.29.69.188:40695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:33107
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:05.731345 20289 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:05.731523 20289 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:05.736263 20298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:05.736474 20295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:05.736485 20296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:05.736773 20289 server_base.cc:1034] running on GCE node
I20260806 15:12:05.736989 20289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:05.737254 20289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:05.738363 20289 hybrid_clock.cc:648] HybridClock initialized: now 1786029125738350 us; error 48 us; skew 500 ppm
Aug 06 15:12:05 dist-test-slave-tm1g krb5kdc[20276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:05.741094 20289 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:12:05.741564 20289 webserver.cc:460] Webserver started at http://127.29.69.190:38557/ using document root <none> and password file <none>
I20260806 15:12:05.741807 20289 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:05.741871 20289 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:05.742020 20289 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:05.743095 20289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "4ea6771c6acf4a049ab56cc32141518b"
format_stamp: "Formatted at 2026-08-06 15:12:05 on dist-test-slave-tm1g"
server_key: "365c58715bb2ef7e3153904ebcebdb3a"
server_key_iv: "ff4edc0f887f4a0f70fcb8cc3dc658c7"
server_key_version: "encryptionkey@0"
I20260806 15:12:05.743446 20289 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "4ea6771c6acf4a049ab56cc32141518b"
format_stamp: "Formatted at 2026-08-06 15:12:05 on dist-test-slave-tm1g"
server_key: "365c58715bb2ef7e3153904ebcebdb3a"
server_key_iv: "ff4edc0f887f4a0f70fcb8cc3dc658c7"
server_key_version: "encryptionkey@0"
I20260806 15:12:05.745033 20289 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:12:05.746449 20305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:05.746629 20289 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:05.746726 20289 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "4ea6771c6acf4a049ab56cc32141518b"
format_stamp: "Formatted at 2026-08-06 15:12:05 on dist-test-slave-tm1g"
server_key: "365c58715bb2ef7e3153904ebcebdb3a"
server_key_iv: "ff4edc0f887f4a0f70fcb8cc3dc658c7"
server_key_version: "encryptionkey@0"
I20260806 15:12:05.746798 20289 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:05.774740 20289 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:05.776635 20289 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:05.776789 20289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:05.780782 20289 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:33107
I20260806 15:12:05.780830 20357 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:33107 every 8 connection(s)
I20260806 15:12:05.781188 20289 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:12:05.782171 20358 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:05.783752 20358 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:05.786154 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20289
I20260806 15:12:05.786288 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:12:05.786482 29974 external_mini_cluster.cc:1428] Setting key 1c76725b7198c5541b79ba6496c1f110
Aug 06 15:12:05 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:05.794076 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.784461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49904 (local address 127.29.69.190:33107)
0806 15:12:05.784657 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:05.784666 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:05.784779 (+ 113us) server_negotiation.cc:407] Connection header received
0806 15:12:05.785354 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:05.785355 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:05.785390 (+ 35us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:05.785484 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:05.786025 (+ 541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.786999 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.787984 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.788298 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.788390 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:05.790899 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:05.790907 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:05.790907 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:05.790913 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:05.792417 (+ 1504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:05.792904 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:05.792907 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:05.792908 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:05.792991 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:05.793244 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:05.793245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:05.793245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:05.793479 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:05.793547 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:05.793789 (+ 242us) server_negotiation.cc:299] Negotiation successful
0806 15:12:05.793912 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":143,"thread_start_us":77,"threads_started":1}
I20260806 15:12:05.794099 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.784373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33107 (local address 127.0.0.1:49904)
0806 15:12:05.784646 (+ 273us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.784691 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:05.785188 (+ 497us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:05.785489 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:05.785491 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:05.785763 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:05.785919 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:05.785923 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.787092 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.787093 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:05.787900 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:05.787903 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.788404 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.788405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:05.788486 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:05.789045 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:05.789053 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:05.790800 (+ 1747us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:05.792503 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:05.792511 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:05.792513 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:05.792789 (+ 276us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:05.793066 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:05.793067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:05.793067 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:05.793175 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:05.793555 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:05.793562 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:05.793645 (+ 83us) client_negotiation.cc:769] Sending connection context
0806 15:12:05.793760 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 15:12:05.793994 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"mutex_wait_us":85,"thread_start_us":134,"threads_started":1}
WARNING: no policy specified for kudu/127.29.69.189@KRBTEST.COM; defaulting to no policy
I20260806 15:12:05.794831 20358 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:05.795136 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.795045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59524)
0806 15:12:05.795076 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.795117 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260806 15:12:05.795254 20308 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
I20260806 15:12:05.795712 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.795597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59538)
0806 15:12:05.795658 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.795691 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260806 15:12:05.795851 20358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:34447: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab.
Entry for principal kudu/127.29.69.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab.
I20260806 15:12:05.811079 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:34447
--webserver_interface=127.29.69.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab
--principal=kudu/127.29.69.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:33107,127.29.69.189:34447,127.29.69.188:40695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:12:05.845074 20358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } attempt: 1
I20260806 15:12:05.845561 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.845429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59546)
0806 15:12:05.845491 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.845529 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 15:12:05.845892 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.845793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59554)
0806 15:12:05.845835 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.845859 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 15:12:05.845970 20358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:34447: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
W20260806 15:12:05.897905 20366 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:12:05.898154 20366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:05.898192 20366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:05.898249 20366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:05.899448 20366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:05.899515 20366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:05.899540 20366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:05.899569 20366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:05.899598 20366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:05.901093 20366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:33107,127.29.69.189:34447,127.29.69.188:40695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab
--principal=kudu/127.29.69.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:34447
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.69.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:05.901366 20366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:05.901600 20366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:05.906407 20372 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:05.906407 20371 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:05.906421 20374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:05.906596 20366 server_base.cc:1034] running on GCE node
I20260806 15:12:05.906855 20366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:05.907141 20366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:05.908299 20366 hybrid_clock.cc:648] HybridClock initialized: now 1786029125908292 us; error 34 us; skew 500 ppm
Aug 06 15:12:05 dist-test-slave-tm1g krb5kdc[20276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:05.910789 20366 init.cc:377] Logged in from keytab as kudu/127.29.69.189@KRBTEST.COM (short username kudu)
I20260806 15:12:05.911242 20366 webserver.cc:460] Webserver started at http://127.29.69.189:44395/ using document root <none> and password file <none>
I20260806 15:12:05.911427 20366 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:05.911468 20366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:05.911566 20366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:05.912586 20366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data/instance:
uuid: "77b775060b47460abf844f2ef76c6406"
format_stamp: "Formatted at 2026-08-06 15:12:05 on dist-test-slave-tm1g"
server_key: "bcd623f5a6a5b29035ad17cda1d4beff"
server_key_iv: "7bbd923634a39d23a0bdb0dcb2910e87"
server_key_version: "encryptionkey@0"
I20260806 15:12:05.912891 20366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal/instance:
uuid: "77b775060b47460abf844f2ef76c6406"
format_stamp: "Formatted at 2026-08-06 15:12:05 on dist-test-slave-tm1g"
server_key: "bcd623f5a6a5b29035ad17cda1d4beff"
server_key_iv: "7bbd923634a39d23a0bdb0dcb2910e87"
server_key_version: "encryptionkey@0"
I20260806 15:12:05.914112 20358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } attempt: 2
I20260806 15:12:05.914156 20366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260806 15:12:05.914543 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.914415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59560)
0806 15:12:05.914478 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.914509 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260806 15:12:05.914920 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.914822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59574)
0806 15:12:05.914868 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.914897 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 15:12:05.915021 20358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:34447: Network error: Client connection negotiation failed: client connection to 127.29.69.189:34447: connect: Connection refused (error 111)
I20260806 15:12:05.915036 20381 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:05.915202 20366 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:05.915290 20366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal
uuid: "77b775060b47460abf844f2ef76c6406"
format_stamp: "Formatted at 2026-08-06 15:12:05 on dist-test-slave-tm1g"
server_key: "bcd623f5a6a5b29035ad17cda1d4beff"
server_key_iv: "7bbd923634a39d23a0bdb0dcb2910e87"
server_key_version: "encryptionkey@0"
I20260806 15:12:05.915343 20366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:05.923895 20366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:05.925642 20366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:05.925750 20366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:05.929773 20366 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.189:34447
I20260806 15:12:05.929836 20433 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.189:34447 every 8 connection(s)
I20260806 15:12:05.930178 20366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
I20260806 15:12:05.931314 20434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:05.933027 20434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:05.935726 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20366
I20260806 15:12:05.935863 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-1/wal/instance
I20260806 15:12:05.936054 29974 external_mini_cluster.cc:1428] Setting key 96fc09df8c8f98ba1f873de78bfe94d5
Aug 06 15:12:05 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:05.943171 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.933736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49906 (local address 127.29.69.190:33107)
0806 15:12:05.933806 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:05.933808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:05.934015 (+ 207us) server_negotiation.cc:407] Connection header received
0806 15:12:05.934554 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:05.934555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:05.934567 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:05.934627 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:05.935229 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.935773 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.937393 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.937737 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.937812 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:05.940267 (+ 2455us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:05.940269 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:05.940269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:05.940277 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:05.941688 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:05.942137 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:05.942139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:05.942139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:05.942200 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:05.942510 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:05.942511 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:05.942512 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:05.942634 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:05.942708 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:05.942989 (+ 281us) server_negotiation.cc:299] Negotiation successful
0806 15:12:05.943077 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260806 15:12:05.943413 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.933695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33107 (local address 127.0.0.1:49906)
0806 15:12:05.933893 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.933934 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:05.934461 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:05.934698 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:05.934702 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:05.934954 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:05.935142 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:05.935145 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.935898 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.935900 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:05.937273 (+ 1373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:05.937276 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.937851 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.937853 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:05.937965 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:05.938504 (+ 539us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:05.938512 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:05.940168 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:05.941813 (+ 1645us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:05.941821 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:05.941823 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:05.942057 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:05.942268 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:05.942269 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:05.942270 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:05.942440 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:05.942701 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:05.942708 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:05.942854 (+ 146us) client_negotiation.cc:769] Sending connection context
0806 15:12:05.942955 (+ 101us) client_negotiation.cc:240] Negotiation successful
0806 15:12:05.943120 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":114,"threads_started":1}
WARNING: no policy specified for kudu/127.29.69.188@KRBTEST.COM; defaulting to no policy
I20260806 15:12:05.944001 20434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.188@KRBTEST.COM" created.
Aug 06 15:12:05 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:05.951819 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.944288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59584)
0806 15:12:05.944334 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.944346 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:05.944389 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:05.944652 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:05.944653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:05.944826 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:05.944886 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:05.944888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.945782 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.945783 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:05.946365 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:05.946368 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.947029 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.947030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:05.947115 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:05.947462 (+ 347us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:05.947468 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:05.948792 (+ 1324us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:05.950740 (+ 1948us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:05.950741 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:05.950741 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:05.950910 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:05.951123 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:05.951124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:05.951124 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:05.951180 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:05.951474 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:05.951475 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:05.951513 (+ 38us) client_negotiation.cc:769] Sending connection context
0806 15:12:05.951575 (+ 62us) client_negotiation.cc:240] Negotiation successful
0806 15:12:05.951681 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260806 15:12:05.951845 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.944374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59584 (local address 127.29.69.189:34447)
0806 15:12:05.944498 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:05.944502 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:05.944516 (+ 14us) server_negotiation.cc:407] Connection header received
0806 15:12:05.944532 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:05.944533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:05.944542 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:05.944595 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:05.944980 (+ 385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.945688 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.946437 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:05.946939 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:05.947002 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:05.948917 (+ 1915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:05.948925 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:05.948925 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:05.948932 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:05.950653 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:05.950999 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:05.951002 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:05.951003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:05.951061 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:05.951245 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:05.951246 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:05.951246 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:05.951400 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:05.951483 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:05.951612 (+ 129us) server_negotiation.cc:299] Negotiation successful
0806 15:12:05.951733 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
I20260806 15:12:05.952630 20434 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:05.953004 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.952888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37226)
0806 15:12:05.952932 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.952976 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 15:12:05.953159 20382 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
I20260806 15:12:05.953611 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:05.953521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37230)
0806 15:12:05.953563 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:05.953588 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260806 15:12:05.953801 20434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:40695: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab.
Entry for principal kudu/127.29.69.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab.
I20260806 15:12:05.963035 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:40695
--webserver_interface=127.29.69.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab
--principal=kudu/127.29.69.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:40283
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:33107,127.29.69.189:34447,127.29.69.188:40695
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:12:06.003047 20434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } attempt: 1
I20260806 15:12:06.003566 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.003426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37238)
0806 15:12:06.003492 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.003534 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260806 15:12:06.003898 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.003806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37244)
0806 15:12:06.003848 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.003879 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 15:12:06.003979 20434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:40695: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
I20260806 15:12:06.006181 20358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } attempt: 3
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:06.014037 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.006658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59588 (local address 127.29.69.189:34447)
0806 15:12:06.006700 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.006702 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.006713 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:12:06.006774 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.006774 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.006785 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.006829 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.007243 (+ 414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.007793 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.008809 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.009046 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.009111 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.011236 (+ 2125us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.011237 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.011238 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.011245 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.012732 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.013095 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.013097 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.013097 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.013157 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.013358 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.013359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.013359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.013563 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.013685 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.013851 (+ 166us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.013938 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:12:06.014050 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.006592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59588)
0806 15:12:06.006652 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.006663 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:06.006708 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:06.006858 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:06.006859 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:06.007049 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:06.007132 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.007135 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.007879 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.007880 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.008698 (+ 818us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.008701 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.009121 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.009122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.009202 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.009675 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:06.009680 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:06.011137 (+ 1457us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:06.012837 (+ 1700us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.012846 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.012846 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.013022 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.013223 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.013224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.013224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.013287 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.013681 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:06.013682 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:06.013735 (+ 53us) client_negotiation.cc:769] Sending connection context
0806 15:12:06.013823 (+ 88us) client_negotiation.cc:240] Negotiation successful
0806 15:12:06.013937 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260806 15:12:06.014845 20358 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:06.015218 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.015119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37260)
0806 15:12:06.015167 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.015197 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 15:12:06.015575 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.015488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37266)
0806 15:12:06.015531 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.015555 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260806 15:12:06.015666 20358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:40695: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
W20260806 15:12:06.045475 20441 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:12:06.045677 20441 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:06.045696 20441 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:06.045717 20441 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:06.046893 20441 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
I20260806 15:12:06.046838 20358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } attempt: 1
W20260806 15:12:06.046934 20441 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:06.046952 20441 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:06.046964 20441 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:06.046976 20441 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:06.047300 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.047176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37280)
0806 15:12:06.047232 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.047270 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260806 15:12:06.047657 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.047564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37286)
0806 15:12:06.047606 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.047631 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260806 15:12:06.047744 20358 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:40695: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
I20260806 15:12:06.048635 20441 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:40283
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:33107,127.29.69.189:34447,127.29.69.188:40695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab
--principal=kudu/127.29.69.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:40695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.69.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20441
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:06.048890 20441 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:06.049149 20441 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:06.053944 20449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:06.054236 20441 server_base.cc:1034] running on GCE node
W20260806 15:12:06.053961 20447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:06.053954 20446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:06.054665 20441 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:06.054939 20441 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:06.056090 20441 hybrid_clock.cc:648] HybridClock initialized: now 1786029126056075 us; error 39 us; skew 500 ppm
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029126, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:06.058672 20441 init.cc:377] Logged in from keytab as kudu/127.29.69.188@KRBTEST.COM (short username kudu)
I20260806 15:12:06.059052 20441 webserver.cc:460] Webserver started at http://127.29.69.188:35259/ using document root <none> and password file <none>
I20260806 15:12:06.059247 20441 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:06.059286 20441 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:06.059373 20441 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:06.060374 20441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data/instance:
uuid: "689a515221e548dbbbfdf73c2b84bc7f"
format_stamp: "Formatted at 2026-08-06 15:12:06 on dist-test-slave-tm1g"
server_key: "d58e2d8826f5e67ebd121becf7d5fa29"
server_key_iv: "2a7d50a608b59a41c9684d9545c6871a"
server_key_version: "encryptionkey@0"
I20260806 15:12:06.060678 20441 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal/instance:
uuid: "689a515221e548dbbbfdf73c2b84bc7f"
format_stamp: "Formatted at 2026-08-06 15:12:06 on dist-test-slave-tm1g"
server_key: "d58e2d8826f5e67ebd121becf7d5fa29"
server_key_iv: "2a7d50a608b59a41c9684d9545c6871a"
server_key_version: "encryptionkey@0"
I20260806 15:12:06.061939 20441 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260806 15:12:06.062686 20456 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:06.062860 20441 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:06.062968 20441 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal
uuid: "689a515221e548dbbbfdf73c2b84bc7f"
format_stamp: "Formatted at 2026-08-06 15:12:06 on dist-test-slave-tm1g"
server_key: "d58e2d8826f5e67ebd121becf7d5fa29"
server_key_iv: "2a7d50a608b59a41c9684d9545c6871a"
server_key_version: "encryptionkey@0"
I20260806 15:12:06.063040 20441 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:06.072109 20434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } attempt: 2
I20260806 15:12:06.072502 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.072380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37292)
0806 15:12:06.072435 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.072470 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 15:12:06.072853 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.072757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37302)
0806 15:12:06.072803 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.072828 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260806 15:12:06.072956 20434 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:40695: Network error: Client connection negotiation failed: client connection to 127.29.69.188:40695: connect: Connection refused (error 111)
I20260806 15:12:06.073791 20441 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:06.076009 20441 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:06.076171 20441 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:06.080034 20441 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.188:40695
I20260806 15:12:06.080070 20510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.188:40695 every 8 connection(s)
I20260806 15:12:06.080420 20441 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
I20260806 15:12:06.081413 20511 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:06.083026 20511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:06.087710 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20441
I20260806 15:12:06.087788 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786028857624334-29974-0/minicluster-data/master-2/wal/instance
I20260806 15:12:06.087953 29974 external_mini_cluster.cc:1428] Setting key ffa407a20cdfcc54973831c6ddffd003
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029126, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:06.091915 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.083690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49922 (local address 127.29.69.190:33107)
0806 15:12:06.083749 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.083751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.083961 (+ 210us) server_negotiation.cc:407] Connection header received
0806 15:12:06.084414 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.084416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.084428 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.084472 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.085041 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.085524 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.086519 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.086697 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.086743 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.089001 (+ 2258us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.089003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.089003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.089011 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.090514 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.090878 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.090879 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.090879 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.090942 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.091164 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.091165 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.091166 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.091308 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.091366 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.091689 (+ 323us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.091808 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260806 15:12:06.092031 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.083666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:33107 (local address 127.0.0.1:49922)
0806 15:12:06.083846 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.083881 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:06.084323 (+ 442us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:06.084545 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:06.084548 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:06.084786 (+ 238us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:06.084974 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.084978 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.085601 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.085602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.086446 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.086449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.086768 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.086770 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.086871 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.087289 (+ 418us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:06.087297 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:06.088923 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:06.090590 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.090596 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.090597 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.090811 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.091007 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.091007 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.091007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.091107 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.091372 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:06.091376 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:06.091517 (+ 141us) client_negotiation.cc:769] Sending connection context
0806 15:12:06.091645 (+ 128us) client_negotiation.cc:240] Negotiation successful
0806 15:12:06.091813 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":102,"threads_started":1}
I20260806 15:12:06.092880 20511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029126, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:06.097723 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.088341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37308 (local address 127.29.69.188:40695)
0806 15:12:06.088590 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.088594 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.088619 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:12:06.088657 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.088659 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.088679 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.088743 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.089500 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.090342 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.091271 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.091680 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.091743 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.094551 (+ 2808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.094564 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.094565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.094571 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.096366 (+ 1795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.096769 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.096772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.096772 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.096825 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.097034 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.097035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.097035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.097203 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.097327 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.097503 (+ 176us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.097594 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":112,"threads_started":1}
I20260806 15:12:06.100466 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.093144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:34447 (local address 127.0.0.1:59594)
0806 15:12:06.093195 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.093206 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:06.093252 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:06.093381 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:06.093382 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:06.093520 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:06.093568 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.093569 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.094498 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.094499 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.094992 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.094994 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.095579 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.095580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.095659 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.096030 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:06.096034 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:06.097406 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:06.099488 (+ 2082us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.099489 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.099489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.099720 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.099909 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.099910 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.099910 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.099987 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.100203 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:06.100204 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:06.100246 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 15:12:06.100316 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:12:06.100402 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260806 15:12:06.100521 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.093206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59594 (local address 127.29.69.189:34447)
0806 15:12:06.093251 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.093253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.093262 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:12:06.093315 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.093316 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.093324 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.093368 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.093640 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.094412 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.095066 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.095396 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.095464 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.097498 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.097500 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.097500 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.097508 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.099397 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.099795 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.099796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.099796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.099849 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.100046 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.100046 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.100047 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.100146 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.100199 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.100352 (+ 153us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.100429 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:12:06.100953 20511 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029126, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:06.106979 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.098870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.29.69.190:33107)
0806 15:12:06.098906 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.098908 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.098935 (+ 27us) server_negotiation.cc:407] Connection header received
0806 15:12:06.098956 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.098956 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.098964 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.099003 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.099580 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.100254 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.101396 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.101599 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.101649 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.104049 (+ 2400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.104051 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.104051 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.104058 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.105761 (+ 1703us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.106095 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.106096 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.106096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.106154 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.106382 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.106383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.106383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.106529 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.106700 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.106801 (+ 101us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.106881 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:12:06.108853 20513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.101233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37316)
0806 15:12:06.101273 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.101282 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:06.101319 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:06.101769 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:06.101770 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:06.101924 (+ 154us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:06.101972 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.101974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.102970 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.102971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.103476 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.103478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.104004 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.104005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.104059 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.104451 (+ 392us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:06.104456 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:06.105853 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:06.107836 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.107836 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.107837 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.108035 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.108233 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.108234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.108234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.108288 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.108519 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:06.108520 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:06.108565 (+ 45us) client_negotiation.cc:769] Sending connection context
0806 15:12:06.108646 (+ 81us) client_negotiation.cc:240] Negotiation successful
0806 15:12:06.108741 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260806 15:12:06.108901 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.101277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37316 (local address 127.29.69.188:40695)
0806 15:12:06.101309 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.101310 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.101318 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:12:06.101688 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.101688 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.101697 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.101752 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.102064 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.102872 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.103569 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.103888 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.103970 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.105914 (+ 1944us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.105915 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.105916 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.105922 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.107757 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.108113 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.108114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.108115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.108166 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.108353 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.108354 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.108355 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.108459 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.108528 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.108667 (+ 139us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.108789 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":18}
I20260806 15:12:06.110201 20511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: Bootstrap starting.
I20260806 15:12:06.111089 20511 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:06.111382 20511 log.cc:824] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: Log is configured to *not* fsync() on all Append() calls
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:06.112210 20511 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: No bootstrap required, opened a new log
I20260806 15:12:06.113958 20511 raft_consensus.cc:348] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.114120 20511 raft_consensus.cc:729] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 689a515221e548dbbbfdf73c2b84bc7f, State: Initialized, Role: FOLLOWER
I20260806 15:12:06.114251 20511 consensus_queue.cc:260] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.114640 20511 sys_catalog.cc:564] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:06.114607 20517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.114693 20517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:06.115197 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.107761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.29.69.189:34447)
0806 15:12:06.107811 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.107813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.107850 (+ 37us) server_negotiation.cc:407] Connection header received
0806 15:12:06.107911 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.107912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.107922 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.107967 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.108407 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.108872 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.109841 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.110055 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.110137 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.112518 (+ 2381us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.112520 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.112520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.112528 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.113887 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.114287 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.114288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.114288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.114385 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.114625 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.114626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.114626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.114781 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.114978 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.115017 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.115094 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 15:12:06.116577 20528 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:06.116633 20528 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:06.117200 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:12:06.118259 20332 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "4ea6771c6acf4a049ab56cc32141518b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49924
I20260806 15:12:06.116943 20441 master_runner.cc:186] Error getting master registration for 127.29.69.190:33107: OK, instance_id { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" instance_seqno: 1786029125779682 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 15:12:06.119529 20441 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 15:12:06.122871 20358 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } attempt: 2
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:06.130210 20360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.123118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37328)
0806 15:12:06.123162 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.123173 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:06.123212 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:06.123324 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:06.123324 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:06.123507 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:06.123556 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.123558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.124158 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.124160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.124946 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.124948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.125274 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.125275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.125344 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.125828 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:06.125834 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:06.127386 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:06.129084 (+ 1698us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.129086 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.129086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.129323 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.129528 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.129529 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.129529 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.129604 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.129897 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:06.129898 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:06.129944 (+ 46us) client_negotiation.cc:769] Sending connection context
0806 15:12:06.130017 (+ 73us) client_negotiation.cc:240] Negotiation successful
0806 15:12:06.130112 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260806 15:12:06.130220 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.123176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37328 (local address 127.29.69.188:40695)
0806 15:12:06.123233 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.123235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.123243 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:12:06.123264 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.123265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.123273 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.123321 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.123622 (+ 301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.124081 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.125016 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.125204 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.125276 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.127466 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.127467 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.127467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.127474 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.128998 (+ 1524us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.129395 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.129397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.129397 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.129454 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.129667 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.129668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.129668 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.129832 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.129896 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.130047 (+ 151us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.130125 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260806 15:12:06.131764 20358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b: Bootstrap starting.
I20260806 15:12:06.132490 20358 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:06.132798 20358 log.cc:824] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:06.133635 20358 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b: No bootstrap required, opened a new log
I20260806 15:12:06.135011 20358 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.135151 20358 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ea6771c6acf4a049ab56cc32141518b, State: Initialized, Role: FOLLOWER
I20260806 15:12:06.135237 20358 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.135576 20358 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:06.135708 20332 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:12:06.135761 20332 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:06.136665 20332 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.136942 20332 leader_election.cc:288] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [CANDIDATE]: Term 1 election: Requested vote from peers 77b775060b47460abf844f2ef76c6406 (127.29.69.189:34447), 689a515221e548dbbbfdf73c2b84bc7f (127.29.69.188:40695)
I20260806 15:12:06.135521 20531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.137328 20531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:12:06.138394 20542 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260806 15:12:06.138686 20483 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4ea6771c6acf4a049ab56cc32141518b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "689a515221e548dbbbfdf73c2b84bc7f"
I20260806 15:12:06.138809 20483 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:06.139729 20483 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ea6771c6acf4a049ab56cc32141518b in term 1.
I20260806 15:12:06.139979 20306 leader_election.cc:302] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ea6771c6acf4a049ab56cc32141518b, 689a515221e548dbbbfdf73c2b84bc7f; no voters:
I20260806 15:12:06.140152 20531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:12:06.138470 20289 master_runner.cc:186] Error getting master registration for 127.29.69.189:34447: OK, instance_id { permanent_uuid: "77b775060b47460abf844f2ef76c6406" instance_seqno: 1786029125928602 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 15:12:06.140396 20289 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 15:12:06.140350 20531 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [term 1 LEADER]: Becoming Leader. State: Replica: 4ea6771c6acf4a049ab56cc32141518b, State: Running, Role: LEADER
W20260806 15:12:06.138463 20542 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:06.140609 20531 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.141104 20531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ea6771c6acf4a049ab56cc32141518b. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.141252 20531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:06.151146 20361 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.138119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49934 (local address 127.29.69.190:33107)
0806 15:12:06.138159 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.138161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.142474 (+ 4313us) server_negotiation.cc:407] Connection header received
0806 15:12:06.142577 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.142578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.142590 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.142659 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.143370 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.144134 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.145189 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.145520 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.145589 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.147236 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.147238 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.147238 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.147246 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.149150 (+ 1904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.149768 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.149769 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.149769 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.149840 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.150180 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.150181 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.150181 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.150405 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.150493 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.150910 (+ 417us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.151021 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260806 15:12:06.153806 20438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.140482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59614 (local address 127.29.69.189:34447)
0806 15:12:06.140534 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.140547 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.146473 (+ 5926us) server_negotiation.cc:407] Connection header received
0806 15:12:06.146572 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.146573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.146586 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.146639 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.147263 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.148000 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.149059 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.149376 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.149417 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.150931 (+ 1514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.150932 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.150932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.150940 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.152600 (+ 1660us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.152977 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.152978 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.152979 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.153049 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.153261 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.153261 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.153262 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.153395 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.153490 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.153616 (+ 126us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.153709 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:12:06.154455 20553 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:12:06.154737 20553 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:12:06.160951 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.140170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37334 (local address 127.29.69.188:40695)
0806 15:12:06.140204 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.140206 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.146650 (+ 6444us) server_negotiation.cc:407] Connection header received
0806 15:12:06.147357 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.147358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.147369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.147401 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.154383 (+ 6982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.155127 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.156155 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.156462 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.156546 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.158007 (+ 1461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.158008 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.158009 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.158016 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.159738 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.160144 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.160145 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.160146 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.160204 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.160401 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.160402 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.160402 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.160533 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.160635 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.160765 (+ 130us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.160854 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:12:06.164103 20434 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } attempt: 3
I20260806 15:12:06.167338 20483 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [term 1 FOLLOWER]: Refusing update from remote peer 4ea6771c6acf4a049ab56cc32141518b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:12:06.167716 20550 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [LEADER]: Connected to new peer: Peer: permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:12:06.169116 20517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ea6771c6acf4a049ab56cc32141518b. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.169220 20517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: This master's current role is: FOLLOWER
Aug 06 15:12:06 dist-test-slave-tm1g krb5kdc[20276](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029125, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:06.171700 20550 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.171800 20550 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:06.172854 20517 sys_catalog.cc:455] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.172931 20517 sys_catalog.cc:458] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:06.173542 20554 mvcc.cc:205] Tried to move back new op lower bound from 7315575300778504192 to 7315575300672978944. Current Snapshot: MvccSnapshot[applied={T|T < 7315575300778504192}]
I20260806 15:12:06.173743 20555 mvcc.cc:205] Tried to move back new op lower bound from 7315575300778504192 to 7315575300672978944. Current Snapshot: MvccSnapshot[applied={T|T < 7315575300778504192}]
I20260806 15:12:06.173818 20436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.164366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:40695 (local address 127.0.0.1:37350)
0806 15:12:06.164422 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:06.164435 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:06.164485 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:06.164617 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:06.164618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:06.164788 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:06.164859 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.164862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.165859 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.165860 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.166647 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:06.166650 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.167168 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.167170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:06.167240 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.167758 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:06.167764 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:06.170219 (+ 2455us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:06.172204 (+ 1985us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.172205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.172206 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.172461 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.172784 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:06.172785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:06.172785 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:06.172857 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:06.173496 (+ 639us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:06.173496 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:06.173545 (+ 49us) client_negotiation.cc:769] Sending connection context
0806 15:12:06.173615 (+ 70us) client_negotiation.cc:240] Negotiation successful
0806 15:12:06.173717 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260806 15:12:06.174453 20515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:06.164458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37350 (local address 127.29.69.188:40695)
0806 15:12:06.164494 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.164496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.164521 (+ 25us) server_negotiation.cc:407] Connection header received
0806 15:12:06.164541 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.164542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.164550 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.164611 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.164931 (+ 320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.165732 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.166776 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:06.167052 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:06.168419 (+ 1367us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:06.170327 (+ 1908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:06.170328 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:06.170329 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:06.170335 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:06.172108 (+ 1773us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.172627 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.172628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.172629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.172700 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:06.172932 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:06.172933 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:06.172933 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:06.173412 (+ 479us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:06.173487 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:06.174266 (+ 779us) server_negotiation.cc:299] Negotiation successful
0806 15:12:06.174363 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260806 15:12:06.174729 20553 catalog_manager.cc:1347] Generated new cluster ID: 831ddd8eaa194afd885d6ba5d7a97e4e
I20260806 15:12:06.174782 20553 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:12:06.175983 20434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: Bootstrap starting.
I20260806 15:12:06.176717 20434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:06.177013 20434 log.cc:824] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:06.177873 20434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: No bootstrap required, opened a new log
I20260806 15:12:06.180400 20434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.180595 20434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77b775060b47460abf844f2ef76c6406, State: Initialized, Role: FOLLOWER
I20260806 15:12:06.180720 20434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } }
I20260806 15:12:06.181134 20434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:06.181217 20407 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:06.182070 20407 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [term 1 FOLLOWER]: Refusing update from remote peer 4ea6771c6acf4a049ab56cc32141518b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:12:06.182462 20531 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [LEADER]: Connected to new peer: Peer: permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:12:06.182245 20408 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4ea6771c6acf4a049ab56cc32141518b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "77b775060b47460abf844f2ef76c6406"
I20260806 15:12:06.181109 20560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.185230 20560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:06.185292 20560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4ea6771c6acf4a049ab56cc32141518b. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.185352 20560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:06.185381 20560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.185422 20560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:06.186250 20573 mvcc.cc:205] Tried to move back new op lower bound from 7315575300778504192 to 7315575300672978944. Current Snapshot: MvccSnapshot[applied={T|T < 7315575300778504192}]
I20260806 15:12:06.186424 20408 raft_consensus.cc:2396] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ea6771c6acf4a049ab56cc32141518b for term 1 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
W20260806 15:12:06.186928 20571 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:06.186992 20571 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:06.209664 20531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4ea6771c6acf4a049ab56cc32141518b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4ea6771c6acf4a049ab56cc32141518b" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 33107 } } peers { permanent_uuid: "77b775060b47460abf844f2ef76c6406" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 34447 } } peers { permanent_uuid: "689a515221e548dbbbfdf73c2b84bc7f" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 40695 } } }
I20260806 15:12:06.209802 20531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:06.211440 20553 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:12:06.212280 20553 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:12:06.227968 20553 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4ea6771c6acf4a049ab56cc32141518b: Generated new TSK 0
I20260806 15:12:06.228194 20553 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:12:06.256994 20361 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.255658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49936 (local address 127.29.69.190:33107)
0806 15:12:06.255708 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.255711 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.256309 (+ 598us) server_negotiation.cc:407] Connection header received
0806 15:12:06.256419 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.256421 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.256433 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.256464 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.256926 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:49936: BlockingRecv error: recv got EOF from 127.0.0.1:49936 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 15:12:06.258034 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.256028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59624 (local address 127.29.69.189:34447)
0806 15:12:06.256070 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.256072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.257462 (+ 1390us) server_negotiation.cc:407] Connection header received
0806 15:12:06.257613 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.257614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.257626 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.257657 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.257968 (+ 311us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59624: BlockingRecv error: recv got EOF from 127.0.0.1:59624 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260806 15:12:06.258901 20515 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.257278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37360 (local address 127.29.69.188:40695)
0806 15:12:06.257318 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.257320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.258243 (+ 923us) server_negotiation.cc:407] Connection header received
0806 15:12:06.258441 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.258442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.258452 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.258481 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.258833 (+ 352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37360: BlockingRecv error: recv got EOF from 127.0.0.1:37360 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 15:12:06.263476 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.262626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59638 (local address 127.29.69.189:34447)
0806 15:12:06.262664 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.262665 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.262884 (+ 219us) server_negotiation.cc:407] Connection header received
0806 15:12:06.263007 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.263009 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.263035 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.263067 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.263424 (+ 357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59638: BlockingRecv error: recv got EOF from 127.0.0.1:59638 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 15:12:06.266744 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.265844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59652 (local address 127.29.69.189:34447)
0806 15:12:06.265878 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.265880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.266142 (+ 262us) server_negotiation.cc:407] Connection header received
0806 15:12:06.266241 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.266242 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.266252 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.266279 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.266699 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59652: BlockingRecv error: recv got EOF from 127.0.0.1:59652 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 15:12:06.270776 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.269917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59666 (local address 127.29.69.189:34447)
0806 15:12:06.269952 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.269954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.270212 (+ 258us) server_negotiation.cc:407] Connection header received
0806 15:12:06.270348 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.270349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.270360 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.270387 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.270734 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59666: BlockingRecv error: recv got EOF from 127.0.0.1:59666 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 15:12:06.276664 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.275879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59678 (local address 127.29.69.189:34447)
0806 15:12:06.275916 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.275918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.276148 (+ 230us) server_negotiation.cc:407] Connection header received
0806 15:12:06.276237 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.276238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.276247 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.276276 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.276621 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59678: BlockingRecv error: recv got EOF from 127.0.0.1:59678 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 15:12:06.286702 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.285836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59694 (local address 127.29.69.189:34447)
0806 15:12:06.285876 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.285878 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.286115 (+ 237us) server_negotiation.cc:407] Connection header received
0806 15:12:06.286212 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.286213 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.286224 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.286252 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.286645 (+ 393us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59694: BlockingRecv error: recv got EOF from 127.0.0.1:59694 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 15:12:06.304759 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.304002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59710 (local address 127.29.69.189:34447)
0806 15:12:06.304050 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.304053 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.304191 (+ 138us) server_negotiation.cc:407] Connection header received
0806 15:12:06.304255 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.304256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.304268 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.304333 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.304684 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59710: BlockingRecv error: recv got EOF from 127.0.0.1:59710 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260806 15:12:06.338640 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.337861 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59726 (local address 127.29.69.189:34447)
0806 15:12:06.337909 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.337911 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.338051 (+ 140us) server_negotiation.cc:407] Connection header received
0806 15:12:06.338129 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.338130 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.338141 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.338186 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.338566 (+ 380us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59726: BlockingRecv error: recv got EOF from 127.0.0.1:59726 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260806 15:12:06.404646 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.403889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59732 (local address 127.29.69.189:34447)
0806 15:12:06.403956 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.403958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.404026 (+ 68us) server_negotiation.cc:407] Connection header received
0806 15:12:06.404089 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.404090 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.404101 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.404152 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.404588 (+ 436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59732: BlockingRecv error: recv got EOF from 127.0.0.1:59732 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
W20260806 15:12:06.534751 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.534030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59740 (local address 127.29.69.189:34447)
0806 15:12:06.534098 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.534100 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.534110 (+ 10us) server_negotiation.cc:407] Connection header received
0806 15:12:06.534148 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.534149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.534160 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.534226 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.534696 (+ 470us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59740: BlockingRecv error: recv got EOF from 127.0.0.1:59740 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260806 15:12:06.792748 20438 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:06.792108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59748 (local address 127.29.69.189:34447)
0806 15:12:06.792182 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:06.792184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:06.792196 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:12:06.792267 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:06.792268 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:06.792279 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:06.792343 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:06.792673 (+ 330us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59748: BlockingRecv error: recv got EOF from 127.0.0.1:59748 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260806 15:12:07.117121 20528 catalog_manager.cc:1259] Loaded cluster ID: 831ddd8eaa194afd885d6ba5d7a97e4e
I20260806 15:12:07.117204 20528 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: loading cluster ID for follower catalog manager: success
I20260806 15:12:07.118074 20528 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: acquiring CA information for follower catalog manager: success
I20260806 15:12:07.118489 20528 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 689a515221e548dbbbfdf73c2b84bc7f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:12:07.187402 20571 catalog_manager.cc:1259] Loaded cluster ID: 831ddd8eaa194afd885d6ba5d7a97e4e
I20260806 15:12:07.187512 20571 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: loading cluster ID for follower catalog manager: success
I20260806 15:12:07.188356 20571 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: acquiring CA information for follower catalog manager: success
I20260806 15:12:07.188671 20571 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 77b775060b47460abf844f2ef76c6406: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:12:07.308691 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:07.306089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59754 (local address 127.29.69.189:34447)
0806 15:12:07.306199 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:07.306202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:07.306224 (+ 22us) server_negotiation.cc:407] Connection header received
0806 15:12:07.306320 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:07.306321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:07.306376 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:07.306450 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:07.306600 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.307107 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.307874 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.308082 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.308130 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:07.308288 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:07.308396 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:07.308454 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:07.308550 (+ 96us) server_negotiation.cc:299] Negotiation successful
0806 15:12:07.308571 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":53,"threads_started":1}
I20260806 15:12:07.313000 20647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:07.310537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37366 (local address 127.29.69.188:40695)
0806 15:12:07.310658 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:07.310660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:07.310669 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:12:07.310715 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:07.310715 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:07.310763 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:07.310843 (+ 80us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:07.310945 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.311435 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.312169 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.312404 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.312488 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:07.312653 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:07.312760 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:07.312843 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:07.312883 (+ 40us) server_negotiation.cc:299] Negotiation successful
0806 15:12:07.312907 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
I20260806 15:12:07.317399 20641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:07.314906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59770 (local address 127.29.69.189:34447)
0806 15:12:07.314965 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:07.314967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:07.314998 (+ 31us) server_negotiation.cc:407] Connection header received
0806 15:12:07.315067 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:07.315068 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:07.315080 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:07.315136 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:07.315338 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.315851 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.316654 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.316861 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.316932 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:07.317077 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:07.317115 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:07.317166 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:07.317279 (+ 113us) server_negotiation.cc:299] Negotiation successful
0806 15:12:07.317301 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260806 15:12:07.318253 20654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:07.314682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49946 (local address 127.29.69.190:33107)
0806 15:12:07.314798 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:07.314801 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:07.314963 (+ 162us) server_negotiation.cc:407] Connection header received
0806 15:12:07.315019 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:07.315020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:07.315076 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:07.315152 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:07.315340 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.316145 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.317284 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.317618 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.317675 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:07.317911 (+ 236us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:07.318024 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:07.318086 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:07.318150 (+ 64us) server_negotiation.cc:299] Negotiation successful
0806 15:12:07.318173 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":58,"threads_started":1}
I20260806 15:12:07.318228 20647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:07.314719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37382 (local address 127.29.69.188:40695)
0806 15:12:07.314757 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:07.314759 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:07.314993 (+ 234us) server_negotiation.cc:407] Connection header received
0806 15:12:07.315103 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:07.315104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:07.315113 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:07.315143 (+ 30us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:07.315366 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.316093 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.317289 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:07.317577 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:07.317615 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:07.317974 (+ 359us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:07.318008 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:07.318064 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:07.318133 (+ 69us) server_negotiation.cc:299] Negotiation successful
0806 15:12:07.318158 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:12:07.319929 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20289
I20260806 15:12:07.327605 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20366
I20260806 15:12:07.333314 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20441
2026-08-06T15:12:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2855 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 06 15:12:07 dist-test-slave-tm1g krb5kdc[20658](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 06 15:12:07 dist-test-slave-tm1g krb5kdc[20658](info): set up 2 sockets
Aug 06 15:12:07 dist-test-slave-tm1g krb5kdc[20658](info): commencing operation
krb5kdc: starting...
W20260806 15:12:08.390980 29974 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/test-user.keytab.
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-06T15:12:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-06T15:12:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.29.69.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
Entry for principal kudu/127.29.69.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab.
I20260806 15:12:08.517779 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46743
--webserver_interface=127.29.69.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46743,127.29.69.189:39455,127.29.69.188:35587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260806 15:12:08.598970 20671 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:12:08.599221 20671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:08.599252 20671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:08.599299 20671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:08.600433 20671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:08.600508 20671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:08.600533 20671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:08.600571 20671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:08.600602 20671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:08.602082 20671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46743,127.29.69.189:39455,127.29.69.188:35587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.190.keytab
--principal=kudu/127.29.69.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.190:46743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.29.69.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:08.602383 20671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:08.602627 20671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:08.607437 20679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:08.607599 20671 server_base.cc:1034] running on GCE node
W20260806 15:12:08.607452 20676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:08.607728 20677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:08.607991 20671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:08.608278 20671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:08.609467 20671 hybrid_clock.cc:648] HybridClock initialized: now 1786029128609440 us; error 36 us; skew 500 ppm
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:08.617049 20671 init.cc:377] Logged in from keytab as kudu/127.29.69.190@KRBTEST.COM (short username kudu)
I20260806 15:12:08.617537 20671 webserver.cc:460] Webserver started at http://127.29.69.190:40753/ using document root <none> and password file <none>
I20260806 15:12:08.617818 20671 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:08.617890 20671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:08.618055 20671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:08.619211 20671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data/instance:
uuid: "ca7bb99399b149ba92d6fcffe75f95f5"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "d88832ab08941b46e0c574a2539970d7"
server_key_iv: "12e1089f1981916fb657a837f3d9ee07"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.619593 20671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal/instance:
uuid: "ca7bb99399b149ba92d6fcffe75f95f5"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "d88832ab08941b46e0c574a2539970d7"
server_key_iv: "12e1089f1981916fb657a837f3d9ee07"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.621066 20671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260806 15:12:08.621896 20686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:08.622128 20671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260806 15:12:08.622233 20671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal
uuid: "ca7bb99399b149ba92d6fcffe75f95f5"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "d88832ab08941b46e0c574a2539970d7"
server_key_iv: "12e1089f1981916fb657a837f3d9ee07"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.622341 20671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:08.647704 20671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:08.650122 20671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:08.650317 20671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:08.654371 20671 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.190:46743
I20260806 15:12:08.654533 20740 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.190:46743 every 8 connection(s)
I20260806 15:12:08.654798 20671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/data/info.pb
I20260806 15:12:08.655774 20741 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:08.657251 20741 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:08.663291 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20671
I20260806 15:12:08.663409 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-0/wal/instance
I20260806 15:12:08.663612 29974 external_mini_cluster.cc:1428] Setting key f2a2188122be316ccaef5e8879b35afd
I20260806 15:12:08.666518 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.657914 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34270 (local address 127.29.69.190:46743)
0806 15:12:08.658045 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.658049 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.658154 (+ 105us) server_negotiation.cc:407] Connection header received
0806 15:12:08.658693 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.658695 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.658711 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.658784 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.659295 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.660103 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.660949 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.661257 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.661333 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.663258 (+ 1925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.663267 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.663267 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.663275 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.664879 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.665279 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.665282 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.665282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.665373 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.665598 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.665599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.665599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.665805 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.665898 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.666082 (+ 184us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.666253 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":19,"server-negotiator.queue_time_us":108,"thread_start_us":87,"threads_started":1}
I20260806 15:12:08.666525 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.657843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46743 (local address 127.0.0.1:34270)
0806 15:12:08.657993 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.658039 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.658562 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.658815 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.658817 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.659054 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.659214 (+ 160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.659217 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.660204 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.660205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.660874 (+ 669us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.660876 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.661343 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.661344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.661398 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.661821 (+ 423us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.661828 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.663169 (+ 1341us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.664979 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.664985 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.664987 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.665183 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.665439 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.665440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.665440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.665529 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.665873 (+ 344us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.665879 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.665940 (+ 61us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.666055 (+ 115us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.666321 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":109,"thread_start_us":66,"threads_started":1}
I20260806 15:12:08.667193 20741 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:08.667516 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.667402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59774)
0806 15:12:08.667444 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.667488 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260806 15:12:08.667639 20688 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
I20260806 15:12:08.668035 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.667942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59776)
0806 15:12:08.667988 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.668012 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260806 15:12:08.668144 20741 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:39455: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.29.69.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab.
Entry for principal kudu/127.29.69.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab.
I20260806 15:12:08.689754 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:39455
--webserver_interface=127.29.69.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab
--principal=kudu/127.29.69.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46743,127.29.69.189:39455,127.29.69.188:35587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:12:08.717386 20741 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } attempt: 1
I20260806 15:12:08.717994 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.717834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59792)
0806 15:12:08.717912 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.717962 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":54}
I20260806 15:12:08.718457 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.718281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59808)
0806 15:12:08.718393 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.718433 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91}
W20260806 15:12:08.718586 20741 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:39455: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
W20260806 15:12:08.773530 20748 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:12:08.773734 20748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:08.773751 20748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:08.773772 20748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:08.774981 20748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:08.775022 20748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:08.775036 20748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:08.775049 20748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:08.775065 20748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:08.776496 20748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46743,127.29.69.189:39455,127.29.69.188:35587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.189.keytab
--principal=kudu/127.29.69.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.189:39455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.29.69.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:08.776678 20748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:08.776850 20748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:08.781733 20753 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:08.781773 20756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:08.781960 20748 server_base.cc:1034] running on GCE node
W20260806 15:12:08.781733 20754 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:08.782294 20748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:08.782604 20748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:08.783748 20748 hybrid_clock.cc:648] HybridClock initialized: now 1786029128783736 us; error 26 us; skew 500 ppm
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:08.786264 20748 init.cc:377] Logged in from keytab as kudu/127.29.69.189@KRBTEST.COM (short username kudu)
I20260806 15:12:08.786731 20748 webserver.cc:460] Webserver started at http://127.29.69.189:35553/ using document root <none> and password file <none>
I20260806 15:12:08.786742 20741 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } attempt: 2
I20260806 15:12:08.787055 20748 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:08.787128 20748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:08.787237 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.787026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59812)
0806 15:12:08.787111 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.787192 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260806 15:12:08.787302 20748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:08.787628 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.787540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59826)
0806 15:12:08.787585 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.787610 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260806 15:12:08.787770 20741 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.189:39455: Network error: Client connection negotiation failed: client connection to 127.29.69.189:39455: connect: Connection refused (error 111)
I20260806 15:12:08.788555 20748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data/instance:
uuid: "5894f5d82a8343548a61a56deccd89b2"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "e5a1f47fb515f3b8c7973cebb0ef35e9"
server_key_iv: "0ec467577406ca53904c9e6d259d66e8"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.788928 20748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal/instance:
uuid: "5894f5d82a8343548a61a56deccd89b2"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "e5a1f47fb515f3b8c7973cebb0ef35e9"
server_key_iv: "0ec467577406ca53904c9e6d259d66e8"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.790283 20748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260806 15:12:08.791181 20763 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:08.791397 20748 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:08.791641 20748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal
uuid: "5894f5d82a8343548a61a56deccd89b2"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "e5a1f47fb515f3b8c7973cebb0ef35e9"
server_key_iv: "0ec467577406ca53904c9e6d259d66e8"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.791744 20748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:08.816640 20748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:08.818750 20748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:08.818928 20748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:08.823072 20748 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.189:39455
I20260806 15:12:08.823112 20816 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.189:39455 every 8 connection(s)
I20260806 15:12:08.823501 20748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/data/info.pb
I20260806 15:12:08.824527 20817 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:08.825089 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20748
I20260806 15:12:08.825204 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-1/wal/instance
I20260806 15:12:08.825409 29974 external_mini_cluster.cc:1428] Setting key cf8bde559f3fd992edbd16c19ac51fc3
I20260806 15:12:08.827078 20817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.29.69.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.29.69.188@KRBTEST.COM" created.
I20260806 15:12:08.836933 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.827849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34280 (local address 127.29.69.190:46743)
0806 15:12:08.827924 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.827927 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.828137 (+ 210us) server_negotiation.cc:407] Connection header received
0806 15:12:08.828596 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.828598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.828614 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.828691 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.829327 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.830160 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.831181 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.831527 (+ 346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.831615 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.833957 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.833959 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.833960 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.833968 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.835378 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.835758 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.835759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.835759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.835812 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.836175 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.836176 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.836177 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.836287 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.836347 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.836693 (+ 346us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.836785 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260806 15:12:08.837011 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.827808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46743 (local address 127.0.0.1:34280)
0806 15:12:08.828001 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.828046 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.828493 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.828759 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.828762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.829010 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.829203 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.829207 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.830253 (+ 1046us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.830254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.831098 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.831100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.831645 (+ 545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.831646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.831757 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.832306 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.832314 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.833872 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.835460 (+ 1588us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.835467 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.835468 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.835690 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.835920 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.835921 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.835921 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.836095 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.836351 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.836356 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.836556 (+ 200us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.836670 (+ 114us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.836815 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":116,"threads_started":1}
I20260806 15:12:08.838672 20817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:08.845988 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.838965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59836)
0806 15:12:08.839018 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.839029 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.839085 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.839312 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.839313 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.839449 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.839492 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.839493 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.840430 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.840431 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.840916 (+ 485us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.840918 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.841399 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.841400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.841461 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.841871 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.841876 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.843364 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.845089 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.845090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.845091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.845249 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.845442 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.845442 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.845442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.845495 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.845760 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.845760 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.845796 (+ 36us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.845845 (+ 49us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.845923 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:12:08.846179 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.839013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59836 (local address 127.29.69.189:39455)
0806 15:12:08.839176 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.839180 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.839200 (+ 20us) server_negotiation.cc:407] Connection header received
0806 15:12:08.839224 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.839226 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.839235 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.839312 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.839567 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.840334 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.841008 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.841313 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.841399 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.843455 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.843462 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.843462 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.843468 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.844994 (+ 1526us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.845317 (+ 323us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.845319 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.845320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.845383 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.845535 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.845571 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.845571 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.845701 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.845764 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.845886 (+ 122us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.845972 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":21,"server-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260806 15:12:08.846810 20817 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:08.847146 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.847018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:33954)
0806 15:12:08.847077 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.847127 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260806 15:12:08.847303 20766 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
I20260806 15:12:08.847692 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.847606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:33968)
0806 15:12:08.847653 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.847677 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 15:12:08.847808 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:35587: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.29.69.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab.
Entry for principal kudu/127.29.69.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab.
I20260806 15:12:08.852620 29974 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJcRv5_/build/release/bin/kudu
/tmp/dist-test-taskJcRv5_/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:35587
--webserver_interface=127.29.69.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab
--principal=kudu/127.29.69.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.29.69.148:33193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.29.69.190:46743,127.29.69.189:39455,127.29.69.188:35587
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260806 15:12:08.878937 20741 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } attempt: 3
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:08.886215 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.879482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59850 (local address 127.29.69.189:39455)
0806 15:12:08.879556 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.879559 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.879570 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:12:08.879605 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.879606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.879617 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.879682 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.880017 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.880536 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.881261 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.881488 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.881568 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.883680 (+ 2112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.883681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.883682 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.883695 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.885031 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.885399 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.885400 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.885401 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.885465 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.885671 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.885672 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.885672 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.885786 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.885857 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.886039 (+ 182us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.886117 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 15:12:08.886230 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.879372 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59850)
0806 15:12:08.879440 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.879458 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.879519 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.879689 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.879690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.879861 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.879928 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.879930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.880622 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.880624 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.881170 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.881172 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.881565 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.881566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.881651 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.882145 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.882150 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.883580 (+ 1430us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.885121 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.885122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.885123 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.885297 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.885533 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.885534 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.885535 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.885601 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.885859 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.885860 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.885907 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.886010 (+ 103us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.886113 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 15:12:08.886829 20741 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:08.887200 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.887093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:33976)
0806 15:12:08.887145 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.887177 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260806 15:12:08.887627 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.887493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:33992)
0806 15:12:08.887577 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.887607 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
W20260806 15:12:08.887753 20741 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:35587: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
I20260806 15:12:08.897028 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } attempt: 1
I20260806 15:12:08.897516 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.897369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:33994)
0806 15:12:08.897431 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.897477 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260806 15:12:08.897969 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.897844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34002)
0806 15:12:08.897897 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.897933 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260806 15:12:08.898109 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:35587: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
I20260806 15:12:08.918918 20741 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } attempt: 1
I20260806 15:12:08.919477 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.919330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34014)
0806 15:12:08.919404 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.919449 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260806 15:12:08.919852 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.919770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34028)
0806 15:12:08.919810 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.919834 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260806 15:12:08.919955 20741 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:35587: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
W20260806 15:12:08.936146 20824 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260806 15:12:08.936344 20824 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260806 15:12:08.936362 20824 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260806 15:12:08.936381 20824 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260806 15:12:08.937619 20824 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260806 15:12:08.937661 20824 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260806 15:12:08.937676 20824 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260806 15:12:08.937690 20824 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260806 15:12:08.937701 20824 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260806 15:12:08.939244 20824 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.29.69.148:33193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.29.69.190:46743,127.29.69.189:39455,127.29.69.188:35587
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/krb5kdc/kudu_127.29.69.188.keytab
--principal=kudu/127.29.69.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.29.69.188:35587
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.29.69.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20824
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 06 Aug 2026 14:02:25 UTC on ccycloud.quasar-zyippm.root.comops.site
build id 4570387
I20260806 15:12:08.939492 20824 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260806 15:12:08.939735 20824 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260806 15:12:08.944808 20832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260806 15:12:08.944813 20829 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:08.944840 20824 server_base.cc:1034] running on GCE node
W20260806 15:12:08.944826 20830 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260806 15:12:08.945288 20824 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260806 15:12:08.945636 20824 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260806 15:12:08.946775 20824 hybrid_clock.cc:648] HybridClock initialized: now 1786029128946762 us; error 25 us; skew 500 ppm
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260806 15:12:08.949282 20824 init.cc:377] Logged in from keytab as kudu/127.29.69.188@KRBTEST.COM (short username kudu)
I20260806 15:12:08.949738 20824 webserver.cc:460] Webserver started at http://127.29.69.188:37685/ using document root <none> and password file <none>
I20260806 15:12:08.949970 20824 fs_manager.cc:359] Metadata directory not provided
I20260806 15:12:08.950037 20824 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260806 15:12:08.950189 20824 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260806 15:12:08.951279 20824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data/instance:
uuid: "837f6de2a29a48d5b4a32d7f2eb713eb"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "12efbac6339a857c9d5ec071be829b33"
server_key_iv: "9b96c6ab27a75659091f15f4bdedfb7c"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.951645 20824 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal/instance:
uuid: "837f6de2a29a48d5b4a32d7f2eb713eb"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "12efbac6339a857c9d5ec071be829b33"
server_key_iv: "9b96c6ab27a75659091f15f4bdedfb7c"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.953074 20824 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260806 15:12:08.953832 20839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260806 15:12:08.954017 20824 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260806 15:12:08.954119 20824 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data,/tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal
uuid: "837f6de2a29a48d5b4a32d7f2eb713eb"
format_stamp: "Formatted at 2026-08-06 15:12:08 on dist-test-slave-tm1g"
server_key: "12efbac6339a857c9d5ec071be829b33"
server_key_iv: "9b96c6ab27a75659091f15f4bdedfb7c"
server_key_version: "encryptionkey@0"
I20260806 15:12:08.954205 20824 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260806 15:12:08.963864 20824 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260806 15:12:08.966150 20824 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260806 15:12:08.966393 20824 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260806 15:12:08.966379 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } attempt: 2
I20260806 15:12:08.966826 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.966679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34036)
0806 15:12:08.966750 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.966792 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260806 15:12:08.967254 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.967100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34048)
0806 15:12:08.967150 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.967189 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260806 15:12:08.967413 20817 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.29.69.188:35587: Network error: Client connection negotiation failed: client connection to 127.29.69.188:35587: connect: Connection refused (error 111)
I20260806 15:12:08.970818 20824 rpc_server.cc:307] RPC server started. Bound to: 127.29.69.188:35587
I20260806 15:12:08.970868 20892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.29.69.188:35587 every 8 connection(s)
I20260806 15:12:08.971190 20824 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/data/info.pb
I20260806 15:12:08.972244 20893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260806 15:12:08.973740 20893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:08.977591 29974 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJcRv5_/build/release/bin/kudu as pid 20824
I20260806 15:12:08.977721 29974 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJcRv5_/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786028857624334-29974-0/minicluster-data/master-2/wal/instance
I20260806 15:12:08.977957 29974 external_mini_cluster.cc:1428] Setting key 38c590ec19b0af56b774ea5b94a8b119
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:08.983119 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.974428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34292 (local address 127.29.69.190:46743)
0806 15:12:08.974499 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.974501 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.974739 (+ 238us) server_negotiation.cc:407] Connection header received
0806 15:12:08.975204 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.975205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.975213 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.975270 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.975837 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.976315 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.977303 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.977596 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.977676 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.980029 (+ 2353us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.980030 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.980030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.980038 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.981515 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.982070 (+ 555us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.982072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.982072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.982137 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.982482 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.982483 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.982483 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.982606 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.982686 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.982984 (+ 298us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.983053 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260806 15:12:08.983332 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.974392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.190:46743 (local address 127.0.0.1:34292)
0806 15:12:08.974612 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.974654 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.975123 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.975319 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.975322 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.975566 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.975756 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.975759 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.976433 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.976434 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.977222 (+ 788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.977224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.977731 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.977732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.977883 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.978481 (+ 598us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.978490 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.979940 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.981618 (+ 1678us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.981626 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.981628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.981964 (+ 336us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.982212 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.982213 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.982213 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.982389 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.982678 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.982685 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.982839 (+ 154us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.982947 (+ 108us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.983107 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":134,"threads_started":1}
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:08.983937 20893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } has no permanent_uuid. Determining permanent_uuid...
I20260806 15:12:08.987079 20897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.978378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34060 (local address 127.29.69.188:35587)
0806 15:12:08.978556 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.978562 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.978618 (+ 56us) server_negotiation.cc:407] Connection header received
0806 15:12:08.978650 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.978652 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.978673 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.978757 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.979405 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.980317 (+ 912us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.981072 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.981383 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.981465 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.983921 (+ 2456us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.983926 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.983926 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.983933 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.985830 (+ 1897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.986188 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.986191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.986191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.986255 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.986502 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.986503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.986504 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.986649 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.986806 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.986887 (+ 81us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.986973 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":91,"threads_started":1}
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
I20260806 15:12:08.991406 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.984255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.189:39455 (local address 127.0.0.1:59866)
0806 15:12:08.984386 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.984396 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.984456 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.984596 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.984596 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.984764 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.984837 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.984839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.985780 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.985781 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.986253 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.986255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.986707 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.986708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.986781 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.987148 (+ 367us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.987153 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.988653 (+ 1500us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.990292 (+ 1639us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.990293 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.990293 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.990552 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.990759 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.990760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.990761 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.990819 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.991090 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.991091 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.991133 (+ 42us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.991217 (+ 84us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.991314 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115}
I20260806 15:12:08.991446 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.984336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59866 (local address 127.29.69.189:39455)
0806 15:12:08.984400 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.984402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.984435 (+ 33us) server_negotiation.cc:407] Connection header received
0806 15:12:08.984510 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.984511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.984523 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.984597 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.984916 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.985693 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.986381 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.986616 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.986706 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.988747 (+ 2041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.988748 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.988749 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.988756 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.990191 (+ 1435us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.990628 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.990629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.990629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.990691 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.990901 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.990901 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.990902 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.991023 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.991098 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.991277 (+ 179us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.991354 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260806 15:12:08.991842 20893 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } has no permanent_uuid. Determining permanent_uuid...
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.190@KRBTEST.COM
I20260806 15:12:08.995113 20741 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } attempt: 2
I20260806 15:12:08.995632 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.987908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34304 (local address 127.29.69.190:46743)
0806 15:12:08.987943 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.987945 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.987959 (+ 14us) server_negotiation.cc:407] Connection header received
0806 15:12:08.988013 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.988014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.988021 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.988066 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.988608 (+ 542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.989049 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.989902 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.990226 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.990289 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.992717 (+ 2428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.992718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.992719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.992725 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.994334 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.994679 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.994680 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.994680 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.994743 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.994960 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.994961 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.994961 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.995107 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.995376 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.995426 (+ 50us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.995528 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.188@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:08.998900 20895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.992112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34070)
0806 15:12:08.992154 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.992164 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.992200 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.992334 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.992335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.992440 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.992469 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.992470 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.993126 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.993127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.993755 (+ 628us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.993757 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.994325 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.994325 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.994383 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.994797 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:08.994802 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:08.996209 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:08.997898 (+ 1689us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.997898 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.997899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.998060 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.998263 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:08.998263 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:08.998263 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:08.998346 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:08.998587 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:08.998588 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:08.998618 (+ 30us) client_negotiation.cc:769] Sending connection context
0806 15:12:08.998683 (+ 65us) client_negotiation.cc:240] Negotiation successful
0806 15:12:08.998784 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260806 15:12:08.999204 20897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.992169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34070 (local address 127.29.69.188:35587)
0806 15:12:08.992209 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.992211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.992220 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:12:08.992255 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.992256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.992265 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.992314 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.992544 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.993071 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.993835 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.994185 (+ 350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.994258 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:08.996287 (+ 2029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:08.996288 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:08.996289 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:08.996294 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:08.997824 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.998130 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.998132 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.998132 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.998180 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:08.998391 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:08.998392 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:08.998392 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:08.998503 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:08.998568 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:08.999023 (+ 455us) server_negotiation.cc:299] Negotiation successful
0806 15:12:08.999100 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.29.69.189@KRBTEST.COM
Aug 06 15:12:08 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.190@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:09.001151 20893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: Bootstrap starting.
I20260806 15:12:09.002839 20893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:09.003191 20893 log.cc:824] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:09.004359 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.996277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59876 (local address 127.29.69.189:39455)
0806 15:12:08.996313 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.996315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.996323 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:12:08.996377 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.996379 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.996387 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.996442 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.996899 (+ 457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.997353 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.998290 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.998597 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.998677 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.001563 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:09.001564 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:09.001565 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:09.001572 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:09.003064 (+ 1492us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.003465 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.003466 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.003466 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.003530 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.003757 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.003759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.003759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.003918 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:09.004085 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:09.004169 (+ 84us) server_negotiation.cc:299] Negotiation successful
0806 15:12:09.004255 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:12:09.004492 20893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: No bootstrap required, opened a new log
I20260806 15:12:09.004626 20743 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.995352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34082)
0806 15:12:08.995411 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:08.995421 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:08.995454 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:08.995877 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:08.995879 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:08.996035 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:08.996078 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.996080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.997623 (+ 1543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.997624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.998407 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:08.998409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.999559 (+ 1150us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.999560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:08.999623 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.000026 (+ 403us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:09.000032 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:09.001416 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:09.003483 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:09.003484 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:09.003485 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:09.003659 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:09.003905 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:09.003906 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:09.003906 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:09.004000 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:09.004329 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:09.004330 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:09.004377 (+ 47us) client_negotiation.cc:769] Sending connection context
0806 15:12:09.004425 (+ 48us) client_negotiation.cc:240] Negotiation successful
0806 15:12:09.004521 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260806 15:12:09.005077 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:08.995556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34082 (local address 127.29.69.188:35587)
0806 15:12:08.995731 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:08.995733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:08.995741 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:12:08.995760 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:08.995760 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:08.995770 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:08.996151 (+ 381us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:08.996206 (+ 55us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.997540 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.998461 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:08.999475 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:08.999560 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.001516 (+ 1956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:09.001517 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:09.001518 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:09.001525 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:09.003381 (+ 1856us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.003753 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.003754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.003754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.003827 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.004076 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.004077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.004077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.004238 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:09.004816 (+ 578us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:09.004855 (+ 39us) server_negotiation.cc:299] Negotiation successful
0806 15:12:09.004942 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260806 15:12:09.006124 29974 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260806 15:12:09.006652 20893 raft_consensus.cc:348] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.006799 20893 raft_consensus.cc:729] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 837f6de2a29a48d5b4a32d7f2eb713eb, State: Initialized, Role: FOLLOWER
I20260806 15:12:09.006888 20893 consensus_queue.cc:260] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.007151 20900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.007213 20893 sys_catalog.cc:564] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:09.007278 20741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5: Bootstrap starting.
I20260806 15:12:09.007304 20900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:09.008042 20741 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:09.007133 20713 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ca7bb99399b149ba92d6fcffe75f95f5"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34304
I20260806 15:12:09.008360 20741 log.cc:824] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:09.009222 20741 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5: No bootstrap required, opened a new log
I20260806 15:12:09.010623 20741 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
W20260806 15:12:09.010725 20912 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:09.010777 20912 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:09.010768 20741 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca7bb99399b149ba92d6fcffe75f95f5, State: Initialized, Role: FOLLOWER
I20260806 15:12:09.010850 20741 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.011112 20914 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.011162 20741 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:09.011193 20914 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:09.011205 20713 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260806 15:12:09.011287 20713 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:09.012089 20713 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.009460 20824 master_runner.cc:186] Error getting master registration for 127.29.69.190:46743: OK, instance_id { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" instance_seqno: 1786029128653190 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 15:12:09.012341 20824 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260806 15:12:09.012348 20713 leader_election.cc:288] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [CANDIDATE]: Term 1 election: Requested vote from peers 5894f5d82a8343548a61a56deccd89b2 (127.29.69.189:39455), 837f6de2a29a48d5b4a32d7f2eb713eb (127.29.69.188:35587)
I20260806 15:12:09.012763 20866 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb"
I20260806 15:12:09.012894 20866 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:09.013882 20866 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca7bb99399b149ba92d6fcffe75f95f5 in term 1.
I20260806 15:12:09.014149 20689 leader_election.cc:302] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 837f6de2a29a48d5b4a32d7f2eb713eb, ca7bb99399b149ba92d6fcffe75f95f5; no voters:
I20260806 15:12:09.014279 20914 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260806 15:12:09.014559 20914 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [term 1 LEADER]: Becoming Leader. State: Replica: ca7bb99399b149ba92d6fcffe75f95f5, State: Running, Role: LEADER
I20260806 15:12:09.014670 20914 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.015079 20931 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca7bb99399b149ba92d6fcffe75f95f5. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.015228 20931 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:09.013775 20671 master_runner.cc:186] Error getting master registration for 127.29.69.189:39455: OK, instance_id { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" instance_seqno: 1786029128821828 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260806 15:12:09.016846 20671 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260806 15:12:09.013780 20925 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:09.016933 20925 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:09.025954 20744 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:09.016660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34312 (local address 127.29.69.190:46743)
0806 15:12:09.016704 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.016706 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.017310 (+ 604us) server_negotiation.cc:407] Connection header received
0806 15:12:09.017415 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.017416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.017427 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.017457 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.018291 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.019069 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.020183 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.020476 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.020520 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.022281 (+ 1761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:09.022283 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:09.022283 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:09.022290 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:09.024114 (+ 1824us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.024726 (+ 612us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.024727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.024727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.024804 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.025149 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.025150 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.025150 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.025286 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:09.025375 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:09.025746 (+ 371us) server_negotiation.cc:299] Negotiation successful
0806 15:12:09.025834 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260806 15:12:09.030455 20933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260806 15:12:09.030720 20933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260806 15:12:09.034746 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:09.013786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34090 (local address 127.29.69.188:35587)
0806 15:12:09.013829 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.013832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.025436 (+ 11604us) server_negotiation.cc:407] Connection header received
0806 15:12:09.026021 (+ 585us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.026022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.026036 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.026068 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.026816 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.027591 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.028559 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.028934 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.029003 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.031197 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:09.031198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:09.031198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:09.031206 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:09.033364 (+ 2158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.033820 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.033821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.033821 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.033879 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.034082 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.034083 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.034083 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.034209 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:09.034352 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:09.034557 (+ 205us) server_negotiation.cc:299] Negotiation successful
0806 15:12:09.034641 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260806 15:12:09.035387 20822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:09.025850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59884 (local address 127.29.69.189:39455)
0806 15:12:09.025903 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.025905 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.026264 (+ 359us) server_negotiation.cc:407] Connection header received
0806 15:12:09.026390 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.026392 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.026403 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.026436 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.027493 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.028192 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.028954 (+ 762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.029248 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.029319 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.031773 (+ 2454us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:09.031774 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:09.031775 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:09.031782 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:09.033430 (+ 1648us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.034061 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.034062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.034062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.034119 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.034440 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.034441 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.034441 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.034583 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:09.034649 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:09.035198 (+ 549us) server_negotiation.cc:299] Negotiation successful
0806 15:12:09.035289 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260806 15:12:09.043303 20866 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [term 1 FOLLOWER]: Refusing update from remote peer ca7bb99399b149ba92d6fcffe75f95f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:12:09.043684 20931 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:12:09.045116 20900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca7bb99399b149ba92d6fcffe75f95f5. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.045205 20900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:09.051947 20914 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.052044 20914 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:09.052181 20900 sys_catalog.cc:455] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.052270 20900 sys_catalog.cc:458] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:09.052474 20938 mvcc.cc:205] Tried to move back new op lower bound from 7315575312558645248 to 7315575312444768256. Current Snapshot: MvccSnapshot[applied={T|T < 7315575312558645248}]
I20260806 15:12:09.053310 20933 catalog_manager.cc:1347] Generated new cluster ID: 66567455f8b0447f863afb6a8cdf97f4
I20260806 15:12:09.053361 20933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260806 15:12:09.058578 20817 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } attempt: 3
Aug 06 15:12:09 dist-test-slave-tm1g krb5kdc[20658](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786029128, etypes {rep=17 tkt=17 ses=17}, kudu/127.29.69.189@KRBTEST.COM for kudu/127.29.69.188@KRBTEST.COM
I20260806 15:12:09.065249 20933 catalog_manager.cc:1370] Generated new certificate authority record
I20260806 15:12:09.066952 20933 catalog_manager.cc:1504] Loading token signing keys...
I20260806 15:12:09.067698 20820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:09.058828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.29.69.188:35587 (local address 127.0.0.1:34092)
0806 15:12:09.058908 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0806 15:12:09.058920 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0806 15:12:09.058967 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0806 15:12:09.059290 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0806 15:12:09.059291 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0806 15:12:09.059481 (+ 190us) client_negotiation.cc:189] Negotiated authn=SASL
0806 15:12:09.059533 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:09.059536 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.060469 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.060470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:09.061272 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0806 15:12:09.061274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.061826 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.061827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0806 15:12:09.061894 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.062477 (+ 583us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0806 15:12:09.062483 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0806 15:12:09.063988 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0806 15:12:09.065971 (+ 1983us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:09.065973 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:09.065973 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:09.066200 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:09.066482 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0806 15:12:09.066483 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0806 15:12:09.066483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0806 15:12:09.066555 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0806 15:12:09.067374 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0806 15:12:09.067375 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0806 15:12:09.067433 (+ 58us) client_negotiation.cc:769] Sending connection context
0806 15:12:09.067494 (+ 61us) client_negotiation.cc:240] Negotiation successful
0806 15:12:09.067592 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260806 15:12:09.068312 20898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:09.059100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34092 (local address 127.29.69.188:35587)
0806 15:12:09.059147 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.059148 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.059156 (+ 8us) server_negotiation.cc:407] Connection header received
0806 15:12:09.059176 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.059177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.059186 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.059233 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.059615 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.060376 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.061380 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:09.061691 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:09.061748 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:09.064092 (+ 2344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0806 15:12:09.064093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0806 15:12:09.064094 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0806 15:12:09.064101 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0806 15:12:09.065796 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.066285 (+ 489us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.066287 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.066287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.066402 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0806 15:12:09.067121 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0806 15:12:09.067122 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0806 15:12:09.067122 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0806 15:12:09.067272 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0806 15:12:09.067333 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:09.068136 (+ 803us) server_negotiation.cc:299] Negotiation successful
0806 15:12:09.068216 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:12:09.069778 20817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: Bootstrap starting.
I20260806 15:12:09.070541 20817 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: Neither blocks nor log segments found. Creating new log.
I20260806 15:12:09.070830 20817 log.cc:824] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: Log is configured to *not* fsync() on all Append() calls
I20260806 15:12:09.072306 20817 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: No bootstrap required, opened a new log
I20260806 15:12:09.074352 20817 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.074491 20817 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5894f5d82a8343548a61a56deccd89b2, State: Initialized, Role: FOLLOWER
I20260806 15:12:09.074564 20817 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } }
I20260806 15:12:09.074887 20817 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: configured and running, proceeding with master startup.
I20260806 15:12:09.074978 20789 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [term 0 FOLLOWER]: Advancing to term 1
I20260806 15:12:09.075915 20789 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [term 1 FOLLOWER]: Refusing update from remote peer ca7bb99399b149ba92d6fcffe75f95f5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260806 15:12:09.076153 20790 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "5894f5d82a8343548a61a56deccd89b2"
I20260806 15:12:09.076246 20914 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260806 15:12:09.077322 20790 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ca7bb99399b149ba92d6fcffe75f95f5 in term 1.
I20260806 15:12:09.079623 20943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.079790 20943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:09.079885 20943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca7bb99399b149ba92d6fcffe75f95f5. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.079996 20943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: This master's current role is: FOLLOWER
I20260806 15:12:09.080068 20943 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.080156 20943 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2 [sys.catalog]: This master's current role is: FOLLOWER
W20260806 15:12:09.082908 20954 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260806 15:12:09.083076 20954 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260806 15:12:09.085908 20956 mvcc.cc:205] Tried to move back new op lower bound from 7315575312645664768 to 7315575312444768256. Current Snapshot: MvccSnapshot[applied={T|T < 7315575312558645248}]
I20260806 15:12:09.086465 20933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5: Generated new TSK 0
I20260806 15:12:09.086572 20931 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ca7bb99399b149ba92d6fcffe75f95f5" member_type: VOTER last_known_addr { host: "127.29.69.190" port: 46743 } } peers { permanent_uuid: "5894f5d82a8343548a61a56deccd89b2" member_type: VOTER last_known_addr { host: "127.29.69.189" port: 39455 } } peers { permanent_uuid: "837f6de2a29a48d5b4a32d7f2eb713eb" member_type: VOTER last_known_addr { host: "127.29.69.188" port: 35587 } } }
I20260806 15:12:09.086661 20931 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca7bb99399b149ba92d6fcffe75f95f5 [sys.catalog]: This master's current role is: LEADER
I20260806 15:12:09.086651 20933 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260806 15:12:09.111581 20898 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.108635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34100 (local address 127.29.69.188:35587)
0806 15:12:09.108678 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.108681 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.109623 (+ 942us) server_negotiation.cc:407] Connection header received
0806 15:12:09.110873 (+ 1250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.110875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.110888 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.110921 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.111512 (+ 591us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34100: BlockingRecv error: recv got EOF from 127.0.0.1:34100 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 15:12:09.112447 20744 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.109014 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34326 (local address 127.29.69.190:46743)
0806 15:12:09.109053 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.109055 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.111898 (+ 2843us) server_negotiation.cc:407] Connection header received
0806 15:12:09.111990 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.111991 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.112002 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.112045 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.112381 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34326: BlockingRecv error: recv got EOF from 127.0.0.1:34326 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260806 15:12:09.113256 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.109313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59888 (local address 127.29.69.189:39455)
0806 15:12:09.109391 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.109393 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.112703 (+ 3310us) server_negotiation.cc:407] Connection header received
0806 15:12:09.112854 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.112863 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.112875 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.112904 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.113196 (+ 292us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59888: BlockingRecv error: recv got EOF from 127.0.0.1:59888 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 15:12:09.115258 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.114525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59904 (local address 127.29.69.189:39455)
0806 15:12:09.114560 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.114562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.114770 (+ 208us) server_negotiation.cc:407] Connection header received
0806 15:12:09.114877 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.114878 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.114896 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.114925 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.115214 (+ 289us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59904: BlockingRecv error: recv got EOF from 127.0.0.1:59904 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260806 15:12:09.118287 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.117544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59910 (local address 127.29.69.189:39455)
0806 15:12:09.117577 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.117579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.117815 (+ 236us) server_negotiation.cc:407] Connection header received
0806 15:12:09.117901 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.117902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.117912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.117938 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.118242 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59910: BlockingRecv error: recv got EOF from 127.0.0.1:59910 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260806 15:12:09.122295 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.121451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59912 (local address 127.29.69.189:39455)
0806 15:12:09.121498 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.121500 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.121740 (+ 240us) server_negotiation.cc:407] Connection header received
0806 15:12:09.121839 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.121840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.121851 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.121880 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.122253 (+ 373us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59912: BlockingRecv error: recv got EOF from 127.0.0.1:59912 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 15:12:09.128539 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.127721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59928 (local address 127.29.69.189:39455)
0806 15:12:09.127756 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.127758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.128006 (+ 248us) server_negotiation.cc:407] Connection header received
0806 15:12:09.128104 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.128105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.128116 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.128156 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.128493 (+ 337us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59928: BlockingRecv error: recv got EOF from 127.0.0.1:59928 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260806 15:12:09.138801 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.137795 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59944 (local address 127.29.69.189:39455)
0806 15:12:09.137836 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.137838 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.138114 (+ 276us) server_negotiation.cc:407] Connection header received
0806 15:12:09.138218 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.138219 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.138232 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.138262 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.138734 (+ 472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59944: BlockingRecv error: recv got EOF from 127.0.0.1:59944 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 15:12:09.157267 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.156271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59954 (local address 127.29.69.189:39455)
0806 15:12:09.156315 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.156318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.156595 (+ 277us) server_negotiation.cc:407] Connection header received
0806 15:12:09.156702 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.156703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.156716 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.156765 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.157199 (+ 434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59954: BlockingRecv error: recv got EOF from 127.0.0.1:59954 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260806 15:12:09.192665 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.191763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59964 (local address 127.29.69.189:39455)
0806 15:12:09.191814 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.191816 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.192097 (+ 281us) server_negotiation.cc:407] Connection header received
0806 15:12:09.192197 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.192198 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.192211 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.192239 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.192608 (+ 369us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59964: BlockingRecv error: recv got EOF from 127.0.0.1:59964 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260806 15:12:09.258916 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.258091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59976 (local address 127.29.69.189:39455)
0806 15:12:09.258189 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.258191 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.258327 (+ 136us) server_negotiation.cc:407] Connection header received
0806 15:12:09.258432 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.258434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.258447 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.258500 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.258851 (+ 351us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59976: BlockingRecv error: recv got EOF from 127.0.0.1:59976 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
W20260806 15:12:09.388962 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.388279 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.29.69.189:39455)
0806 15:12:09.388460 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.388462 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.388473 (+ 11us) server_negotiation.cc:407] Connection header received
0806 15:12:09.388501 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.388501 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.388512 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.388579 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.388902 (+ 323us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59978: BlockingRecv error: recv got EOF from 127.0.0.1:59978 (error 108)
Metrics: {"server-negotiator.queue_time_us":145}
W20260806 15:12:09.646750 20822 negotiation.cc:337] Failed RPC negotiation. Trace:
0806 15:12:09.646177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59984 (local address 127.29.69.189:39455)
0806 15:12:09.646245 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:09.646247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:09.646259 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:12:09.646341 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:09.646342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:09.646352 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:09.646398 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0806 15:12:09.646702 (+ 304us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59984: BlockingRecv error: recv got EOF from 127.0.0.1:59984 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260806 15:12:10.011356 20912 catalog_manager.cc:1259] Loaded cluster ID: 66567455f8b0447f863afb6a8cdf97f4
I20260806 15:12:10.011439 20912 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: loading cluster ID for follower catalog manager: success
I20260806 15:12:10.012458 20912 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: acquiring CA information for follower catalog manager: success
I20260806 15:12:10.012815 20912 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 837f6de2a29a48d5b4a32d7f2eb713eb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:12:10.083600 20954 catalog_manager.cc:1259] Loaded cluster ID: 66567455f8b0447f863afb6a8cdf97f4
I20260806 15:12:10.083685 20954 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: loading cluster ID for follower catalog manager: success
I20260806 15:12:10.084481 20954 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: acquiring CA information for follower catalog manager: success
I20260806 15:12:10.084748 20954 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5894f5d82a8343548a61a56deccd89b2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260806 15:12:10.162735 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:10.159978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59988 (local address 127.29.69.189:39455)
0806 15:12:10.160117 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:10.160119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:10.160131 (+ 12us) server_negotiation.cc:407] Connection header received
0806 15:12:10.160204 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:10.160205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:10.160259 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:10.160340 (+ 81us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:10.160486 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.161009 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.161840 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.162073 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.162163 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:10.162408 (+ 245us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:10.162526 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:10.162607 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:10.162645 (+ 38us) server_negotiation.cc:299] Negotiation successful
0806 15:12:10.162666 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":92,"threads_started":1}
I20260806 15:12:10.167172 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:10.164685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34114 (local address 127.29.69.188:35587)
0806 15:12:10.164811 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:10.164813 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:10.164820 (+ 7us) server_negotiation.cc:407] Connection header received
0806 15:12:10.164858 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:10.164858 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:10.164895 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:10.164968 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:10.165072 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.165587 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.166363 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.166604 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.166670 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:10.166826 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:10.166930 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:10.166988 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:10.167031 (+ 43us) server_negotiation.cc:299] Negotiation successful
0806 15:12:10.167052 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":56,"threads_started":1}
I20260806 15:12:10.172149 21041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:10.168911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34334 (local address 127.29.69.190:46743)
0806 15:12:10.169043 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:10.169045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:10.169054 (+ 9us) server_negotiation.cc:407] Connection header received
0806 15:12:10.169103 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:10.169104 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:10.169158 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:10.169233 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:10.169330 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.170102 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.171301 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.171515 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.171565 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:10.171746 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:10.171848 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:10.171918 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:10.172015 (+ 97us) server_negotiation.cc:299] Negotiation successful
0806 15:12:10.172040 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":72,"threads_started":1}
I20260806 15:12:10.172420 21033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:10.168892 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34116 (local address 127.29.69.188:35587)
0806 15:12:10.168937 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:10.168939 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:10.169138 (+ 199us) server_negotiation.cc:407] Connection header received
0806 15:12:10.169195 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:10.169196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:10.169208 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:10.169259 (+ 51us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:10.169473 (+ 214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.169946 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.171606 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.171867 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.171931 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:10.172101 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:10.172140 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:10.172199 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:10.172332 (+ 133us) server_negotiation.cc:299] Negotiation successful
0806 15:12:10.172356 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260806 15:12:10.172550 21027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0806 15:12:10.169056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60002 (local address 127.29.69.189:39455)
0806 15:12:10.169095 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0806 15:12:10.169097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0806 15:12:10.169179 (+ 82us) server_negotiation.cc:407] Connection header received
0806 15:12:10.169286 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0806 15:12:10.169287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0806 15:12:10.169299 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0806 15:12:10.169327 (+ 28us) server_negotiation.cc:226] Negotiated authn=TOKEN
0806 15:12:10.169520 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.170221 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.171006 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0806 15:12:10.171224 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0806 15:12:10.171306 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0806 15:12:10.172161 (+ 855us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0806 15:12:10.172196 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0806 15:12:10.172227 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0806 15:12:10.172435 (+ 208us) server_negotiation.cc:299] Negotiation successful
0806 15:12:10.172474 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260806 15:12:10.174208 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20671
I20260806 15:12:10.181114 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20748
I20260806 15:12:10.186820 29974 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJcRv5_/build/release/bin/kudu with pid 20824
2026-08-06T15:12:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2853 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5708 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (272569 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST